Electronic image visualization system and communication methodologies

ABSTRACT

An electronic image visualization system, such as a music stand system and display, management and communications methodologies relating thereto are presented. The electronic music stand system is comprised of a performer subsystem comprising a processing subsystem, librarian logic, performance logic, and communications management logic. The communications management logic provides management of communication via the communications interface with external apparatus responsive to the performance logic and the librarian logic. The user input apparatus and the display apparatus can be integrated into a touch-screen input display. The user input apparatus can alternatively be at least one of a touch-tablet, a stylus-based writing tablet, a mouse, a keyboard, a joystick, a game controller, and a switch. In a preferred embodiment, the librarian logic, the performance logic and the communications management logic are defined by program data stored in the data storage apparatus, and the processor is responsive to the program data for managing data formatting, displaying music, and management of communications of data with the external apparatus. In one embodiment, two Performer subsystems are operable alternatively as one of a single appliance as a linked set a linked mode and as two independent appliances a stand-alone mode, wherein in the linked mode each of the two Performer subsystems operate cooperatively with each other as a linked set to provide a two page display on the video presentation, and wherein in the stand alone mode each of the two Performer subsystems operates independently and mutually exclusive of the other to provide two independent and mutually exclusive single page displays on the video presentation. The present invention also relates to a method for providing for video display of music responsive to the music data stored in a music database. The method is comprised of defining a page of music image data from the music database; defining ordered logical sections; storing the mapping in a memory for selective retrieval; and providing for the video display of the music responsive to the mapping and the storing.

RELATED APPLICATIONS

[0001] This is a continuation-in-part application of Ser. No. 10/323,526filed Dec. 18, 2002—a continuation-in-part application of Ser. No.09/492,218 filed Jan. 27, 2000—a continuation-in-part application ofSer. No. 09/039,952 filed Mar. 16, 1998, now issued as U.S. Pat. No.6,084,168—a continuation-in-part application of Ser. No. 08/677,469filed Jul. 10, 1996, now issued as U.S. Pat. No. 5,728,960.

FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

[0002] Not applicable.

BACKGROUND OF THE INVENTION

[0003] The present invention relates to the field of music. Moreparticularly, the present invention relates to an architecture, system,apparatus and methodology relating to the construction and utilizationof a subsystem (or a plurality of subsystems) for displaying musicalcompositions, either batch or in a real time environment, and processingand communicating music data and/or user performances.

[0004] Music is usually only available in the written form for one (or afixed set of) performer/instrument types in a fixed key. Adaptations orvariations of musical arrangements are complex and costly. Remotelylocated musicians are unable to effectively practice together. Smallcommunities each with only a few musicians are limited to practicingwith the few musicians they have.

[0005] Performers of music have many inconveniences to deal with. Onesuch inconvenience deals with the composing, distribution, andutilization of music display presentation, traditionally sheet music.Another major problem relates to the inconvenience of scheduling andphysical gathering of multiple musicians (including instrumentalists andvocalists), which when combined in their performance provide a musicalensemble or orchestra. For example, high school band practice requiresthat all students be available to practice at the same time at the sameplace (i.e., the school music room). However, this creates difficultiesin that many students have other activities which conflict with bandpractice which is then incomplete. Additionally, when composing,musicians often will come up with an idea when physically not withanother musician.

[0006] Musicians typically work from sheet music. When composing, theywrite the notes down on paper that has a number of staffs. If themusician transposes a composition from one key to another, the notes arealso written down on the staff paper. The scores for differentinstruments must also be generated and written down. All of the scoresare then copied for distribution to other musicians and/or music stores.

[0007] When performing, the sheet music must be found, for all parts tobe played, manually distributed, manually set-up, manually handled (turnpages, etc.). There is also an unfulfilled need for quick access to amore comprehensive database of music for the performing musician,whether he is solo or part of an orchestra. Also, musicians oftenperform audience requests, and require access to sheet music forrequested songs. Presently, there are various combinations of songscompiled in “FAKE” Books, usually by category (e.g., rock, country,blues, big band, etc.). This is only of limited help. Furthermore, theuse of paper sheet music is cumbersome and inconvenient; pages often getdamaged or lost, and indexed access is poor and slow.

[0008] This method of composing and distributing music is inadequatewhen the music is used by a band or orchestra that requires hundreds ofcopies. If the conductor desires the piece to be played in a differentkey or certain sections of the music edited to suit the conductor'stastes, the composition must be rewritten and the new transposed copydistributed to the band or orchestra. This is a very costly,time-consuming, and laborious task if the orchestra has a large numberof members.

[0009] Additionally, if the composition does not have a part for acertain instrument, the conductor must generate the required part fromthe original composition. After the score for the required instrumentshas been generated, the parts must be copied and distributed to theindividual musicians. This, again, is a very costly and laborious taskif the band has a large number of musicians requiring different parts.There is a need, therefore, for a more efficient way of transposing,editing, and distributing music scores.

[0010] Over the past many years, great advances have been made in theelectronic input, storage, and display of music. Electronic bands andorchestras are constructed using computers and MIDI equipment. Programsexist for personal computers (e.g., Apple Macintosh, DOS, and Windowsmachines) for an individual to use the computer for transposing music,composing music. Programs also exists for automatically inputting musicfrom direct performance (such as directly from a keyboard,electronically through MIDI converters (such as for string instruments),via pickups and microphones, and sequencers, tone generators, etc.) Togenerate digital data and/or music notation.

[0011] Musicians often perform both pre-planned and ad hoc compositionsduring the course of a performance. It would therefore be desirable tohave the ability to access a large database of musical compositions ondemand. It would also be desirable to permit communication andsynchronization of a music presentation to multiple performing musicianswho are playing together. It would also be desirable for a performingmusician to have his or her performance of the music input onto anindividual music workstation, and stored, and analyzed by an automatedsystem, and/or communicated to one or more other networked (remote)individual music workstations.

SUMMARY OF THE INVENTION

[0012] In accordance with the present invention, electronic music standapparatus system and methodologies relating thereto are presented. Theelectronic music stand system is comprised of a performer subsystemcomprising a processing subsystem, librarian logic, performance logic,and communications management logic. The communications management logicprovides management of communication via the communications interfacewith external apparatus responsive to the performance logic and thelibrarian logic. The user input apparatus and the display apparatus canbe integrated into a touch-screen input display. The user inputapparatus can alternatively be at least one of a touch-tablet, astylus-based writing tablet, a mouse, a keyboard, a joystick, a gamecontroller, and a switch. In a preferred embodiment, the librarianlogic, the performance logic and the communications management logic aredefined by program data stored in the data storage apparatus, and theprocessor is responsive to the program data for managing dataformatting, displaying music, and management of communications of datawith the external apparatus. In one embodiment, two Performer subsystemsare operable alternatively as one of a single appliance as a linked seta linked mode and as two independent appliances a stand-alone mode,wherein in the linked mode each of the two Performer subsystems operatecooperatively with each other as a linked set to provide a two pagedisplay on the video presentation, and wherein in the stand alone modeeach of the two Performer subsystems operates independently and mutuallyexclusive of the other to provide two independent and mutually exclusivesingle page displays on the video presentation. The present inventionalso relates to a method for providing for video display of musicresponsive to the music data stored in a music database. The method iscomprised of defining a page of music image data from the musicdatabase; defining ordered logical sections; storing the mapping in amemory for selective retrieval; and providing for the video display ofthe music responsive to the mapping and the storing. Bookmarking andnavigation logic provide for quick, user-friendly navigation through thestored pages of music data, including providing for user marking oflocations, entry of bookmark data, etc. A draw mode provides the userwith the ability to annotate an image overlay layer presented atop themusic page display associated with a specific page and location in thestored music data. These and other aspects and attributes of the presentinvention will be discussed with reference to the following drawings andaccompanying specification.

BRIEF DESCRIPTION OF THE DRAWINGS

[0013]FIG. 1 illustrates two types of music workstations stands, in theform of a music stand (105 or 300) with a liquid crystal display, isused by an operator (e.g., performer, conductor, etc.) to select one ormore musical compositions.

[0014]FIG. 2 illustrates a music communication system comprisingmultiple workstations (200) each comprising a display (210), some with atouch-screen input display (211), others with user input such as akeypad (222), a joystick (224), push buttons (225; 226), a microphone(227), and a speaker (228), communication interface means (240) such asa wireless interface including an antenna (231), or alternatively oradditionally a wired or cabled communication interface (240), and alocal microcomputer subsystem (250) that provides local intelligence andmanagement of functions in the workstation.

[0015]FIG. 3 illustrates a hardware architecture for an electronic MusicPerformer System (300) and various peripherals using standard componentsof computer systems.

[0016]FIG. 4 illustrates a hand-held embodiment (410) of a one-screenelectronic music stand performer system (100) of FIG. 1.

[0017]FIG. 5 illustrates two touch-screen displays (503; 504) with acommunications interface (501) providing a two-screen display electronicmusic stand performer system apparatus is illustrated.

[0018]FIG. 6 illustrates an alternate embodiment of an electronicperformer music stand system of FIG. 5 but including three displayscreens.

[0019]FIG. 7A illustrates an alternate embodiment of the PerformerSubsystem (200) implemented utilizing a separate component subsystem(e.g., a single board computer (701; 705; 706; 710) coupled to acomponent touch-screen display or other input and display subsystems(715).

[0020]FIG. 7B illustrates two Performer Subsystems (200) (as illustratedin FIG. 7A) coupled together as a linked set via communicationsinterface coupling (711) on each of the Performer Subsystems (200-A;200-B) via coupling (720), also illustrating the bi-directionalcommunications (220) between the two Performer Subsystems.

[0021]FIG. 7C illustrates the management functions of the communicationsbetween the multiple Performer Systems (e.g., (100; 200; 300; 400)illustrated as managed either by centralized controller (730) oralternatively distributed among a plurality of the Performer Systems.

[0022]FIG. 8 illustrates the functional and logical interaction of thelayers of the software logic architecture of the systems and relative tothe physical hardware architecture of the systems of FIGS. 1-7.

[0023]FIG. 9 illustrates one embodiment of an touch sensitive LCDdisplay used for input control and for displaying the information fromthe processor and memory.

[0024]FIG. 10 illustrates an architecture of plurality of the electronicmusic stand Performer Systems of FIGS. 1-9 (made up of variouselectronic music stand products (800 A-C)) connected by a communicationchannel (801), with network logic (803 A-C) in each product thatself-configures to the environment it finds itself in (such as using theavailable communication channel (801) and finding other products tointeract with).

[0025]FIG. 11 illustrates an alternate embodiment of the presentinvention. In this embodiment, the workstations are remote units (901;902; 903) equipped with a respective receiver (910; 911; 912) thatprovide for receipt of communications including receive music datarepresentations of musical selections or compositions transmitted tothem, and used by members of a marching band.

[0026]FIG. 12 illustrates the overall operation by one embodiment of themusic composition communication workstation.

[0027]FIG. 13 illustrates a functional/logical block diagram for oneembodiment of the present invention, illustrating both structure andstate flow for start up and operation of the electronic music standperformer system in one embodiment.

[0028]FIG. 14 illustrates an alternate embodiment of the presentinvention provided where one or more workstations (105) include, at aminimum, a display of the music notation and is coupled to a mastermusic communications controller (415) that provides for a separate userinput (411) which provides input interface that designate requestedmusical compositions, transformations, and display requests for variousones of the coupled workstations.

[0029]FIG. 15A illustrates the operation of the automated mode “A Mode”(1240) is illustrated, where the user selection of the desired automaticmode is detected and responded to, illustrated as the auto-advance mode(1242), the training mode (1244), the performance mode (1246), or anyone of a number of other modes (1248) as is described in further detailhereinafter.

[0030]FIG. 15B illustrates the automated mode “A Mode 2” (1244)operation of FIG. 15A illustrated corresponding to the training modewherein the system tracks the performance (1280) of the individual userto the composition score, primarily for the purpose of permitting acritical analysis and comparison of the performance to the score (1282).

[0031]FIG. 16 illustrates, in accordance with one aspect of theinvention, a methodology and system is provided for processingstructuring music image data and bookmarks and text related torespective bookmark.

[0032]FIG. 17 illustrates the manual mode (1250), which provides foruser manual selection of functions (1252), such as hitting a button or atouch screen to cause the turning of the page of the display, or to goback a page or to scroll forwards or backwards, or to increase the fontsize or magnification of the music presentation.

[0033]FIG. 18 illustrates the automated mode 1 for auto-advanceoperation (1242) of FIG. 15A, where the user has selected anauto-advance performance mode, “A Mode 1” (1271), wherein the systemtracks the performance by the user of the composition to the musicnotation (e.g. composition or score) (1272).

[0034]FIG. 19 illustrates automated mode 3 “A Mode 3”, the performancemode (1246) wherein the operation is as in automated mode 1(auto-advance mode) except that no user over-ride is permitted andwherein its primary purpose is to accompany the performer during theentire performance of a score as an automated page turner.

[0035]FIG. 20 illustrates the operation of automated mode 4 (“A Mode 4”)which provides for the processing of other automated functions selectedby the system, such as conductor mode, karaoke mode, etc.

[0036]FIG. 21 illustrates a conductor, stage hand, or other person witha sensor glove on each hand (1435) and a head and eye movement monitor(1430), and also illustrates the conductor wearing full body sensorequipment (1440).

[0037]FIG. 22 illustrates an embodiment wherein only the gloves (1435)or body sensors (1444) are used, and the movement of the glove orsensors is captured by a video system.

[0038]FIG. 23 illustrates an alternative method for providing for videodisplay of music stored a music database, wherein after pages have beenloaded in the database they are prepared for display (2300), and thepages are ordered in processing block (2301) (which defines 1^(st)slices) so as to be in logical page order in correspondence to theirpage numbers or some other ordering as desired.

[0039]FIG. 24 illustrates the preparation and processing of the displaydata for video display, comprising dividing a page (2401) into three (orany number of) 1^(st) slices (2410; 2420; 2430), and wherein if a next1^(st) slice is found, processing block (2305) defines 2^(nd) slices,whereafter Processing block (2304) obtains the next 1^(st) slice andprocessing block (2305) defines 2^(nd) slices for each 1^(st) slice.

[0040]FIG. 25 shows typical completely sliced page.

[0041]FIG. 26 illustrates one preferred embodiment for selecting thebookmarks for display.

[0042]FIG. 27 illustrates the logic and flow for event processing inaccordance with one aspect of the present invention.

[0043]FIG. 28 illustrates various objects in accordance with the presentinvention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

[0044] While this invention is susceptible of embodiment in manydifferent forms, there is shown in the drawing, and will be describedherein in detail, specific embodiments thereof with the understandingthat the present disclosure is to be considered as an exemplification ofthe principles of the invention and is not intended to limit theinvention to the specific embodiments illustrated.

[0045] As illustrated in FIG. 1, a system controller, in the form of amusic stand (105) with a liquid crystal display, is used by an operator(e.g., performer, conductor, etc.) to select one or more musicalcompositions. FIG. 1 illustrates two types of music workstations stands.The workstation stand (105) provides certain optional features for amore full-featured stand, including as illustrated, speakers (140) bothwireless and wired communications capability, and as illustrated, showsthe processor with memory (115) as an external separate component. Themaster music stand (300) shows the integration of the processor andmemory into the music stand itself, and also shows both wireless(antenna (101)) and wired connection (port (107)) to permit networkcommunication. Alternatively, the non-master conductor stand (105) canhave all or part of the features integrated into the master music stand(300). Depending on the function for which the music workstation standwill be used, some or all of the features can be provided for that standto minimize costs or optimize versatility. For example, in onesituation, only the teacher or conductor needs the full-featured,full-powered music workstation. In that case, the performers or studentsdo not have a full-feature workstation, but rather a scaled-down versionof the workstation stand. In the preferred embodiment, a user inputdevice (110) (such as a touch screen, microphone, keyboard, switches,voice recognition system, visual recognition system, etc.) is coupled tothe processor in a wired (such as over a cable or fiber optic link) orwireless (such as over an RF link or infrared link) manner forworkstation stand (105), or directly to the processor, where it is builtinto the system controller as a workstation. The user can select anoriginal musical composition from the touch screen of the liquid crystaldisplay (135). The processor responds by storing that composition in thememory (113) of the local workstation of the user as requested.

[0046] Using the touch sensitive LCD (135), the user can now create aderivative musical composition. The touch sensitive LCD allows the userto selectively enter the musical key in which the original compositionwill be played, edit any notes desired, and select the instruments andparts that will be playing the composition. The composition asoriginally composed, and the derivative or modified composition can beplayed back to the user over speakers (140) so that he or she may listen(e.g., such as to observe how the changes will sound) while optionallypermitting simultaneous viewing of the score on the presentation visualdisplay. Once the score has been designated (e.g., selected, edited,etc.) to the users (e.g., conductor's) taste, the appropriate portions(e.g., by musical instrument) of the scores can then be transmitted for(optional storage and) display to the respective associated individualmusic workstation stands of the band members.

[0047] In a preferred embodiment, each stand has an input device (110)that permits the user of the stand to select which instrument will beusing the stand. (As discussed above, this input device can take theform of a touch sensitive screen or a number of buttons or switches orvoice or audio recognition, etc.)

[0048] In the preferred embodiment, each individual music workstationstand (105) can be directly and/or remotely programmed to addressablyreceive (and optionally to locally convert) and display the music scorethat is intended for the respective instrument type (user type) thatwill be using (is associated with) the stand. As an example, the user ofthe stand (or a remote conductor) can input their selection of saxophoneinto the user input device (110) of the workstation stand (105), toprogram that workstation stand (105) only to display and/or receive themusical score for the saxophone (see FIG. 9). Then, the musical scoresfor all selected parts can be independently broadcast to all connectedworkstation stands, with each individual workstation stand individuallydistinguishing and displaying/accepting only its part. Alternatively,each workstation stand can be individually addressed for separatebroadcast reception of its own respective selected part. Additionally,the user of the stand can program the user input to select a musicalpart of a selected musical composition (e.g., saxophone first chair) andreceive only the musical score intended for that chair. This sameprocedure can be followed for other instruments within the band ororchestra. Alternatively, a single music composition can be broadcast toall workstations, where each workstation has local intelligence(processing and storage) to permit local conversion for display at eachworkstation for the selected instrument for each workstation.Alternatively, all workstations can be loaded with all the parts, andthen individually enabled to display only selected parts.

[0049] For wireless communications, the individual music workstationstands (105) are comprised of receivers (or transceivers wherebi-directional communication is desired) and antennas (101, 103) forreceiving (or transceiving) the radio frequency information from (andto) the master workstation (such as for the conductor). The music standalso has a display (such as an LCD (135)) for displaying the musicalscore intended for that stand.

[0050] The form of the musical score communication can be easily shapedto fit needs. One example is MIDI (Musical Instrument Digital Interfacestandard) which has advantages such as of bandwidth of storage used, iswidely available commercially, is standardized, etc. However, signalprocessing, text, icon-based, object based, and various other forms ofstorage, user interface, and processing can also be applied to morespecific applications of product.

[0051] A workstation for an oboe may have a built in slide boom with afeatherweight microphone to be able to receive sound input from theoboe. Electric instruments, such as guitars, keyboards, and otherelectrical analog signal sources can be fed directly to a line inputthat is appropriately buffered and filtered. Signal input can also beaccommodated through a MIDI-interface sub-system that permits bothutilization of data in workstation to workstation communications andutilization of MIDI-output at the station where the data was input.

[0052] The workstation further includes an optional musical instrumentinput (112) and a musical instrument output (113) that permit thecoupling of a musical instrument via a musical instrument interface(114) directly to the workstation. Thus, a keyboard, electric guitarthrough appropriate input, or a microphone input through the interface(114) permits instruments or voices to be directly input to theworkstation for direct input independent of the microphone (127). Seealso FIG. 2.

[0053] It is well known in the art to convert user analog audio inputinto a digital format, ranging from straight Analog to Digital (e.g.,A/D) conversion to processed data conversion to encoded digital musicdata, such as MIDI. Examples of MIDI include guitar input or otherstringed instrument input through microphones or directly toMIDI-converters, or voice/non-pickup instruments through microphoneconverted to MIDI-input, or keyboard MIDI-input. Such input systems arecommercially available from numerous companies for numerous types ofinterfaces at numerous interface levels. Similarly, numerous A/Dconverter subsystems are commercially available at chip and boardsolution levels (such as from Analog Devices Corporation and fromMattrox Systems).

[0054] In accordance with another aspect of the present invention, meansare provided to permit a user of the music workstation to accomplish atransposition of a musical composition in pitch, tempo, and otherwise.In a preferred embodiment, the lead voice or instrument can audiblyindicate the key via the microphone input or via another type of inputstimulus. The workstation can analyze the user input, determine the key,pitch and tempo for a musical composition being partially performed bythe user, and adjust and transform the composition to be displayed inthe new user desired key, pitch, tempo, etc., either solely for use onthat workstation, or communication for use on one or more otherworkstations. In a networked version, this user input can also becommunicated to other workstations for use by one or more of theworkstations in transposing, or communicated to a master workstation,which transposes and rebroadcasts the transposed composition.

[0055] Alternatively, the user can input the pitch, tempo, and key viathe user input (e.g. keypad, joystick, push buttons, voice recognition,playing of an instrument, etc.) and the system performs thetransformation and displays (and/or prints out and/or audibly performs)the modified transformed composition for the user. Additionally, where amusical composition is written for one instrument and a different oradditional instrument version is desired for simultaneous performance,the user can indicate the other instruments via the user input, and thesystem will generate the appropriate displays. The workstation can alsoprovide an audio output of the transformed musical composition, eitherfor the individual additional instrument or voice transform and presentit, or for the composite of additional versions and the originalversion, to hear the blended piece.

[0056] As illustrated in FIG. 1, the music data can be stored locally onthe music workstation (105) or master workstation (300), or can bestored externally (111), such as on a large hard drive or CD ROMjukebox, in a digital format as a music library (120). The music library(120) can be coupled to a processor subsystem (115) for localmanagement, or can be wirelessly coupled via transmitter (125) viaantenna (103). Coupling from the processor subsystem (115) can bewireless or cabled (via coupling 116) such as through a shielded cable,fiber optic conductor, switched connection (such as via phone lines),local, or remote. The processor (115) has the local storage capacity(e.g., semiconductor memory, disk storage, etc.) to hold the digitizedversion of the music composition transmitted to it on request from thelibrary (120), and can provide local user input/output interface anddisplay. The music library can be local or proximately remote from therest of the system.

[0057] The music library can be contained (“stored”) on non-volatilestorage either locally or at a remote central site containing the entire(or a subset) database of all possible music (that is then downloaded tolocal storage on request, either real-time at performance time or inadvance.)

[0058] Alternatively, the music library can be provided on storagemedium that can be easily transported and used on site locally with thepresentation system. Thus, for example, disk drives, cartridges, FLASHRAM cards, plug-in memory modules, or a CD-ROM or multiple CD-ROMs in aCD-ROM changer can be used to store and contain massive data librarieson musical compositions. While this would be a more expensive route thanshared use of a central library, requiring each musical group to obtainlibraries on all possible compositions they may want, it has theadvantage of speed, flexibility, no need for communication with aseparate remote source, and creates a whole new mass marketing area(such as for CDs or Digital Audio Tape (DATs)). Another way of utilizingthis technology is to maintain a history of music used, either with theremote music library or local music library. This could be done for manyreasons, including copyright royalty assessment, determining a historyof musical performances and requests for future use in determiningperformance itineraries, etc. Alternatively, a hybrid of locally storedand centrally shared libraries can be utilized to optimize cost, speedand flexibility benefits.

[0059] A multi CD ROM changer accommodates indexed storage of hundredsof thousands to millions of musical compositions to permit completestand-alone operation of the user music workstation. Alternatively, anoptional built-in or external modem can be provided to permitinter-communication with a remote central music database managementsystem that permits both communication and down loading (and disconnect)for stand alone operation. Thus the workstation can stay on-line,pulling up music as needed, or can request a single or multiple piecesof musical works be provided to it, that are then downloaded from thecentral database manager. The user workstation then disconnects from themusic database management system, and thereafter operates stand-alonewhere all desired music is stored locally in storage (preferablynon-volatile). Storage can be semiconductor, magnetic, optical or anyother medium.

[0060] As described above, the processor subsystem (115) andnon-volatile storage (120) music library can be built directly into oneof the music workstations (105) to be a master (300), with the otherworkstations being slaves, that can either include the processorsubsystem and non-volatile storage or can be lower cost dummy slaveterminals. As illustrated in FIG. 6, a first master workstation (300)provides a basic workstation subsystem (200) plus contains the processorsubsystem (280) and non-volatile storage system (285) as a part thereofso as to provide a complete stand alone music communication system, andbe capable of acting as a master or master/slave. This masterworkstation(s) (300) can function as a stand alone, or can couple to oneor more other workstations, including one or more masters (300) and/orone or more non-master workstations (105).

[0061] The stand alone workstation(s) (105), are coupled to the shareddatabase interface (405), and can either couple remotely (e.g., viaphone lines) to the remote shared music database or to a local shared ordedicated music database (410). The shared music database (410) caneither be primarily a storage means (e.g., hard disk, DVD or CD-ROM), orcan include a processing subsystem (420) for local intelligence. In oneembodiment, the stand-alone music workstation includes the shared musicdatabase (410) and interface (405), non-volatile local storage mediumfor the shared databases (410), and a local processing Subsystem (420),and can operate completely stand-alone. In an alternate embodiment ofthis stand-alone device, the shared database interface is contained inthe stand-alone workstation (but not the shared music database orprocessing subsystem), and provides capability for communication with astored database (410) remote from the stand-alone device.

[0062] Referring to FIG. 2, a music communication system is illustratedcomprising multiple workstations (200) each comprising a display (210),some with a touch-screen input display (211), others with user inputsuch as a keypad (222), a joystick (224), push buttons (225; 226), amicrophone (227), and a speaker (228). The workstation also includescommunication interface means (240) such as a wireless interfaceincluding an antenna (231), or alternatively or additionally a wired orcabled communication interface (240). Each workstation further includesa local microcomputer subsystem (250) that provides local intelligenceand management of functions in the workstation. Each workstation can bea master (e.g. (300)) or non-master (e.g. (105)) workstation.

[0063] An expert system can be built from commercially availabletechnology, including component hardware systems with supportingsoftware, as well as commercially available software packages whichoperate on commodity-type personal and business computers such as theMacintosh by Apple Computer, Windows and DOS machines based on the X86and Pentium processor technology of Intel, technology based on the PowerPC and 68XXX processor by Motorola, DEC PDP-11 technology, Sunworkstations, Fujitsu, Hitachi, Texas Instruments, etc. Custommicrocomputer or DSP based system architecture on a chip can also beconstructed, as well as ASICs, custom or semi-custom logic.

[0064]FIG. 3 illustrates a hardware architecture for an electronic MusicPerformer System (300) and various peripherals using standard componentsof computer systems, such as an AC to DC power adapter (301).Optionally, the user may attach an Uninterruptible Power Supply, UPS(302) for backup power and/or high batteries can be provided within thepackaging for untethered operation as well as for emergency backups. AUSB storage device (e.g. Flash RAM, CD, hard disk (303) is illustratedas one of the optional USB devices that may be attached to the USBinterface (372). The USB devices include wireless (e.g. IEEE 802.11 (a)or (b) access point, MIDI to USB Input/Output Bi-directional Interface,keyboards, mouse, touch-pads, video cameras, microphones, speakers, etc.Footswitches (304) can be coupled (wired or wirelessly) to the printerport (373), serial (RS-232) Adapter (371), USB interface (372), etc. Astandard keyboard and mouse (305) can be coupled to a separate keyboardadapter (371).

[0065] Referring again to FIG. 1, there is illustrated a single(touch-screen input) display embodiment of the electronic music standperformer system (100). The electronics and computing technology ishoused within a casing (102), and a single touch-screen input display(135) is provided, along with network connection (103; 104), digital andanalog input/output connections (106) (such as for coupling tofootswitches, USB connectors, etc.). The vertical support (107). couplesto a mounting bracket on the casing (102). The bottom of the verticalsupport attaches to a floor-base (108). The vertical support (107) andfloor-base (108) can be constructed from any commercially availableproduct (such as available from Wenger, Inc., Minneapolis, Mich. orcustomized construction) as in the description of FIG. 1, providingbalanced support for the weight of the equipment atop it, includingtripod, teardrop shaped cast iron galumenimenn, etc. The verticalsupport (107) and floor-base (108) may be the same or different fromthose provided for the two-screen performer system of FIG. 1.Alternatively, the casing (102) can be handheld with variousweight/handprint combinations of color touch screen systems ranging frompalm (e.g. PDA) size 3″ and under one pound to mobile [e.g. eBook] size8″ and one pound to 10″ and 1.6 pounds to 12″ or 15″ five plus pounds ormounted to another object (from handheld size to stand/piano size e.g. apiano, wall, table, etc., to projection and Arena Size systems (such asare commercially available from Barco Ltd., and other vendors)).

[0066]FIG. 4 illustrates a hand-held embodiment (410) of a one-screenelectronic music stand performer system (100) of FIG. 1. In thisembodiment, the system (410) is made to be portable for being held inthe hands of a performer, a student, a music librarian, stage hands, aproducer, a director, a teacher, etc. The device (410) is preferablybattery operated and communicates via wireless means, such as IEEE802.11 (b) and/or 802.11 (a) systems commercially available fromnumerous venders including Lucent/Orinico, Cisco Systems Inc., Intel,Belden, Apple Computer, and others. Although usually less desirable, ACpower and wired communication are also available options. As illustratedin FIG. 4, the hand-held electronic music stand performer system (410)contains electronics and computing technology housed within a casing(403) and provides for a single touch-screen input display (404).Alternatively, a non-touch-screen input (e.g. touch-pad, mouse,keyboard, switch) and non-touch screen display can form subsystem (404).FIG. 4 also illustrates network communication via coupling (405) (assimilarly illustrated in FIG. 1). Input/output coupling are provided viaconnectors (such as USB, serial) (401) (such as for footswitches), USB,etc. In general, the portable system illustrated in FIG. 4 is lighter inweight, and smaller in size than the systems illustrated in FIG. 1. Inan alternate embodiment, the electronic music stand performer system ofFIG. 3 can be implemented utilizing a PDA (programmable personal digitalassistant) (currently commercial available as Palm Pilot O/S and WinCEapparatus) with appropriate input/output connections, switches, anetwork interface and custom application software providing presentationlogic, librarian logic, communications logic and hardware control.

[0067] Referring to FIG. 5, a two-screen display electronic music standperformer system apparatus is illustrated. The electronic music standapparatus (500) is comprised of a casing (502) that houses electronicsand computing technology comprising: a processor, a non-volatile datastorage apparatus, a communications interface, a user interface for userinput and a display apparatus which can be combined as a touch-screeninput display. FIG. 5 illustrates two touchscreen displays (503; 504).The communications interface (501) provides for coupling to thecommunications interface of the electronic music stand performer system.Wired and wireless communications interfaces (501; 505, as shown in FIG.5), are readily commercially available from multiple vendors and viavarious alternative means, (e.g.: Ethernet, serial, USB, Firewire (IEEE1364) and IEEE 802.11 (a), IEEE 802.11 (b), etc.) Digital connectorsexternal to the casing (502) provide for coupling components via theinterface (501); examples of components include: footswitches,non-volatile storage devices (e.g., USB Flash/RAM, CD-ROMs, hard-drives,other switches control signal sources etc.) Analog connectors (505)provide for coupling of analog signals such as MIDI, SMPTE, click-track(audio signal), Audio In/Audio Out, variable analog control signal (suchas for dimming brightness with house lights in a theater, orchestra pit,or on stage etc., to the interface (501). FIG. 1 shows two pages ofdisplay (503; 504) providing for display of imageinformation—illustrated as music data (506). The present invention alsoincludes display of any image data utilized for facilitating orotherwise enhancing performance, including graphics, text animations,video-in-video, instant messaging, collaborative networking of editingand selective or transfer of music composition, announcements, etc. Theelectronic performer system can also be provided in a modified form forintegrated use on the back of seats in the performing venue or part of aKiosk system in the lobbies of the theater. A centralized server systemprovides for management of the integrated use systems and for providingthe music database.

[0068]FIG. 6 illustrates an alternate embodiment of an electronicperformer music stand system including three display screens. Thethree-screen system embodiment (600), is comprised of a basearchitecture similar to that of FIGS. 1 and 2: a floor-base (609)supports a vertical support (608). The base architecture is coupled to amounting bracket on a casing (602) that houses electronics and computingtechnology for the electronic music stand performer three-screen system(600), and the illustrated embodiment comprises three separatetouch-screen input displays (603; 604; 605). A network interfacecoupling (601) and input/output connections (606) are provided analogousto those illustrated in FIGS. 1, 4 and 5. The embodiment of FIG. 6 maybe comprised of any number of screens greater than two. The screens maybe arranged in any combination of landscape and portrait displayorientations. The option of a multiple-page display adds functionalityand flexibility with regard to intended use. In this embodiment, aperson using the electronic music stand system may view multiple pagesat a time. Therefore, several pages may be advanced or reversed inviewing order respective to the number of displays inherent to thesystem. For example, in the three-screen embodiment of FIG. 4, pages 1,2 and 3 may be displayed at one time, and upon advancement, pages 4, 5and 6 may be displayed. In comparison, for example, FIG. 5 illustratesthe embodiment with two screens displaying pages 1 and 2 simultaneously,and upon advancement, pages 3 and 4 may be displayed. The screens in allmulti-screen embodiments can be positioned side-by-side horizontally,vertically, diagonally, and other ways.

[0069] As illustrated in FIG. 2, the processor subsystem (280) includesan appropriate communications interface (240) such as for wiredinterface (241) or for wireless interface (232) including antenna (233).The processor subsystem couples to a non-volatile storage medium (282)containing, among other things, application programs, transformationprograms, and either a shared music library interface applicationprogram and/or the actual shared music library and access program.

[0070] The processor subsystem can be implemented utilizing amicroprocessor, non-volatile storage memory, read/write memory, andwhatever additional peripheral circuitry is needed (such as areavailable in ASICs, or single chip micro-computer chip sets includingCPUs, DSPs, A/D, and other input/output and peripheral supportcircuitry). These single or multiple chip solutions, or single boardcomputing systems, or general purpose computing systems (e.g. runningwindows, MAC, Lunix, LINUX, Palm O/S, or eBook operating systems), canbe utilized to create a dedicated system to perform complete musicworkstations performance criteria to support an extremely low cost, highvolume music workstation solution.

[0071] Referring to FIG. 7A, an alternate embodiment is illustrated. ThePerformer Subsystem (200) is implemented utilizing a separate componentsubsystem (e.g., a single board computer (701; 705; 706; 710) coupled toa component touch-screen display or other input and display subsystems(715) (such as from Advantech (U.S.A., Taiwan)). The aforementionedcomponents are commercially available from multiple vendors (see forexample EEM, vol. 1-4, 2002; also see IEEE Computer Society; also seeproduct offerings of Intel, AMD, Texas Instruments, Hitachi, Toshiba,and others for all hardware machinery components. Alternatively, theymay be custom-designed and engineered to include a specific feature setto provide for optimal enabling of the claimed invention.

[0072] The electronics and computing technology are contained within acase (e.g. any of the cases (102; 202; 303; 402)) respectivelyillustrated and provides housing for one or more Performer Subsystems(100; 200; 300; 310) therein. In a preferred embodiment, each system hasa touch-screen input display associated with it as a separatestand-alone performer subsystem. In an alternate embodiment, a singleperformer subsystem can provide additional display output capability toprovide for management of a second or multiple other touch-screen inputdisplay utilizing the remainder of the electronics and computingtechnology of the performer subsystem (200).

[0073] In another embodiment, the processing subsystem (processor, datastorage apparatus, communications interface, display output andinput/output connectors) is coupled to a plurality of displayapparatuses with associated input apparatuses that do not utilizetouch-screen input technology. Thus, an inexpensive single-boardcomputer can be utilized with an add-on display apparatus, an inputapparatus and a storage apparatus.

[0074] As illustrated in FIGS. 7B and 7C, in addition to thecommunications between Performer Subsystems (e.g., (200-A; 200-B))comprising one performer system (e.g., 725), communication interfacesand protocols are provided for data exchange to external subsystems andfor other Performer Systems (e.g. (100; 200; 300; 600; 200; 725)). Inone embodiment, communications between the Performer Subsystems withinthe Performer System linked set (intra-communication) and, forcommunications among the Performer Systems (inter-communication) allutilize a shared communications channel. In an alternate embodiment,separate communications interface channels are provided forintra-communications between Performer Subsystems in a linked setPerformer System and for inter-communication among the PerformerSystems, wherein communications are via one or multiple communicationschannels and may utilize any of a variety of technologies including USB,Ethernet, serial, parallel, Firewire, etc. For example, thecommunication between the Performer Subsystems (200-A; 200-B) may beimplemented utilizing one type of communication channel such asEthernet, USB or serial, and communication among Performer Systems maybe implemented utilizing the same communications channel as in thesubsystems or a separate communications channel. Thus for example, twoseparate Ethernet physical connections may be provided to the performersystem—one for communication among internal subsystems(intra-communication) (e.g. wired Ethernet) and one for communicationwith external Performer Systems stand alone or linked(inter-communication) (e.g. wireless). The types of physical connectorsfor communications from subsystem to subsystem and performer system toperformer system can be varied as a matter of design choice.

[0075] As illustrated in FIG. 7B, two Performer Subsystems (200) asillustrated in FIG. 7A) are coupled together as a linked set viacommunications interface coupling (711) on each of the PerformerSubsystems (200-A; 200-B) via coupling (720). More than two subsystems(200) can be coupled together in an alternate linked set embodiment. Thecoupling (720) between the Performer Subsystems (200-A; 200-B) can beprovided via a wired or wireless communications interface, e.g.,Ethernet, serial, USB, Firewire (IEEE 1364) and IEEE 802.11(a), IEEE802.11(b), etc. In one embodiment, using Ethernet, each communicationinterface (710) in a first Performer Subsystem (e.g., 200-A) establishesa listener on a specific port. Another communication interface (710) inanother Performer Subsystem (e.g., 200-B) initiates a communication withthe listener port in the Performer Subsystem (200-A). A communicationsession is then established between Performer Subsystems (200-A; 200-B)using mutually negotiated ports on the respective Performer Subsystems.In the linked set embodiment, the two Performer Subsystems (200-A;200-B) communicate and operate cooperatively to serve as a singletwo-screen performer system (725) operating as a linked set in aninterlinked mode, wherein the two Performer Subsystems (200-A; 200-B)operate as a single electronic music stand performer system applianceproviding for synchronous page-turning. The interlinked mode providesfor regular communication between the two Performer Subsystems (200-A;200-B). In an alternate operational mode—the stand-alone mode—the system(725) provides for independent and mutually exclusive operation of eachof the two or more Performer Subsystems (200-A; 200-B) as stand-aloneelectronic music stand Performer Systems. Each stand-alone electronicmusic stand Performer subsystem (200-A; 200-B) independently providesfor page-turning and display within the system (725).

[0076] In a preferred embodiment, operation of the linked set in theinterlinked mode has an automatic fail-safe operational fallback modeutilized in the interlinked mode operation with two or more PerformerSubsystems (200) within the multi-screen linked set performer system(725). In the automatic fail-safe mode, each of the Performer Subsystems(200-A; 200-B) is further comprised of session monitor logic (722) formonitoring the other one or more of the performer subsystems (200-A;200-B) in the interlinked pair via the communications interface coupling(711). If either performer subsystem (200-A; 200-B) fails to maintainthe communications protocol, the remaining performer subsystem convertsoperation to the stand-alone mode, and continues operation from the timeof operation when it detected the communication failure; thereaftercontinuing in a single page turn mode. System (725) operation isdisrupted during the transition between page/screen utilization states:two-page display (one page displayed on each of two display screens) toone-page display (one page displayed on one display screen). However,because the remaining performer subsystem (200-A; 200-B) continues todisplay data; thereby, maintaining the user's place within the datadisplayed, operational disruption during the transition is minimizedsufficiently so that the user's own performance is not compromised. Ifthe system detects that the communications between the PerformerSubsystems (200-A; 200-B) via communications channel (720) have beenauto-detected as not performing properly, as indicated by signal (713),and the interlinked system operation is converted to stand alone systemoperation by the subsystem detecting that the other subsystem in thelinked set has failed. In a preferred embodiment, an option is providedfor a user manual override of the auto-detect to provide for otheroperational options.

[0077] The system (725) provides for asynchronous or synchronousautomatic detection of communications failure via communications channel(720) connecting Performer Subsystems (200-A; 200-B), whereby theinterlinked system operation is converted to stand-alone system whencommunication failure occurs (Insert From 146). Where there are three ormore performer subsystems a further option provides automatedmulti-screen (3+) linked mode (or a user manual override) of theaforementioned automatic detection of communications failure andconversion to stand alone mode. When the performer system (725) iscomprised of more than two performer subsystems (200-A, 200-B, 200-N)and two or more subsystems detect failure of one of the other PerformerSubsystems (in the automated fail-safe multi-screen (3+) linked mode),and the remaining subsystems operate in the pre-failure configurationmode in the linked mode with the remaining linked subsystem. Forexample, if the performer system (725) is comprised of four screens ofperformers subsystem, and one screen subsystem fails, then the system(725) assumes a linked three-screen synchronous page turning mode.Similarly, if the performer system (225) is comprised of three screens,and one screen fails, then the system (725) assumes a two-screensynchronous page turning mode. Finally, if the performer system iscomprised of two screens, and one screen fails, then the remainingsystem assumes a stand-alone mode operation of a single performersubsystem.

[0078] Referring to FIGS. 7A and 7B, if the system detects that thecommunications between the Performer Subsystems (200-A; 200-B) viacommunications channel (720) have been auto-detected as not performingproperly, as indicated by signal (724), and the interlinked systemoperation is converted to stand alone system operation by the subsystemdetecting that the other subsystem has failed. In a preferredembodiment, an option is provided for a user manual override of theauto-detect to provide for other operational options.

[0079] As illustrated in FIG. 3, the Electronic Music Performer System(300) is comprised of a Computing Core (350), an optional battery backup(310) and other interfaces such as a MIDI interface (311), Buttons(312), indicator LED's (313) and a Wireless network card (314).

[0080] The Computing Core Subsystem (350) is shown as comprised of fourmain components: Touch-screen (351), LCD Display (352), Power Supply(353) and Processor (360). The Display Adapter (365) couples theProcessor (360) to the LCD Display (352). A Touch Adapter (366) couplesthe touch screen (351) to the Processor (360). Providing support for theProcessor (360) are the RAM (361), ROM (362), Hard Disk (363) and FlashDisk (364). Interfacing outside the Computing Core (350) is accomplishedby coupling to selected ones of a number of commercially availablecomponents including Sound Card (370), RS-232 Adapter (371), USBInterface (372), Printer Port (373), Ethernet Adapter (374), PC CardAdapter (375) and Keyboard Adapter (376).

[0081] The Computing Core (360) as illustrated, is commerciallyavailable (loaded with Windows 98, XP, 2000 or NT, UNIX, LINUX, WinCE)operating system software (utilizing a Transmeta microprocessor) fromAdvantech eAutomation, a Taiwanese company having a principal place ofbusiness in Cincinnati, Ohio, as Product No. TPC-1560T. Numerous othertouch screen computers are available from Advantech, Fujitsu, Acer, andothers.

[0082]FIG. 8 illustrates the functional and logical interaction of thelayers of the software logic architecture of the systems and relative tothe physical hardware architecture of the systems of FIGS. 1-7.

[0083] Where there are a plurality of the performer subsystems, andwherein at least two of the Performer subsystems are coupled toselectively provide a linked set operable via a linked mode as a singlecooperative appliance unit, and they are each alternately capable ofbeing operated in the stand-alone mode as two separate appliances.Communications management provides for internal communications betweeneach of the Performer subsystems in the interlinked set that isdistinguishable and mutually exclusive from external communications withthe other ones (not members of the linked set) of the Performersubsystems.

[0084] A Performer Linked System appliance consists of two or moreoperationally independent Performer appliance Subsystems combined to beone integrated appliance system, to provide multiple screens of displaysof the music. Thus, a Performer Subsystem may operate in a stand-alonemode; yet, the same appliance becomes a Performer linked system whenoperating in the linked mode. The Performer Subsystems must communicatewith each other to operate as one integrated system. The communicationschannel may be comprised of, but is not limited to one of the following:universal serial bus (USB), Ethernet, IEEE 802.11 wireless, RS-232,RS-242, serial communications, parallel communications, and Firewire.The communications link between systems is established and thereafterprovides data to each Performer Subsystem to provide an integratedsystem to the musician. Each Performer Subsystem monitors its associatedcommunications channel and detects whether or not the other linkedPerformer Subsystems are actively communicating with it. If a PerformerSubsystem in a linked set detects that any of the linked subsystems arenot active, the remaining Performer Subsystems initiate the creation ofa new Performer System with fewer Performer Subsystems. The PerformerSystem automatically configures itself to optimally display the musicbased upon the total number of linked Performer Subsystems. ThePerformer Subsystem changes from the linked mode to the stand-alone moderesponsive to the aforementioned monitoring and evaluation of associatedcommunications channels (or upon user selection of Stand alone mode).For example, if a Performer System linked set includes three or morelinked Performer Subsystems, and one Performer Subsystem losescommunication and is no longer active, then the remaining two PerformerSubsystems thereafter during operation in the linked set remain in thelinked mode.

[0085] In accordance with the present invention, user interface isdesigned to be musician intuitive. For example, upon power-up, thesystem goes to either a homepage or a defined start page. From thehomepage, the user can select, among their features, musical selectionmanagement, and an options screen displays. The example that followsillustrates an individual stand alone Performer Subsystem beingactivated as part of a linked set Performer System. Initially, a soft(display) button (an area on the touch screen display) on the optionsscreen display is pushed by the user to select to combine this appliance(performer subsystem) with its designated other partner appliance. Ifsuccessfully found this appliance becomes the left screen of thecombined linked set display and the other partner appliance becomes theright screen. The soft button display description then changes to matchthe display. If the user presses the stand-alone mode or stand-alonebutton when the linked set is combined it causes the appliances tobecome stand-alone independent appliances again.

[0086] As illustrated in FIG. 8, the Appliance State (1008) layer logicis coupled to the Appliance Options logic (1006) of the PresentationLayer logic (1005) and to the Message Handler logic (1022) of theNetwork Layer logic (1015). The Appliance State logic (1008) stores thecurrent state of the appliance for reference and startup. The currentpage, orientation, all application options, network options andlibrarian options are saved. Depending on the Application optionssettings (1006), this state is fully or partially restored at thestartup of the appliance.

[0087] In a preferred embodiment, communications among the PerformerSystems provide for peer-to-peer communication. All Performer Systems(single screen or multiple screen linked set embodiments) provide forinter-performer system communication. Thus, the conductor's multiplescreen performer system can communicate with librarian's performersystem, as well as with individual musician's Performer Systems.Preferably, communications between the electronic music stand PerformerSystems appliances is hierarchical—levels of priority and clearance aredesignated for communications. For example, the conductor and librarianmay be assigned the highest priority level. The principal chairs foreach of the sections in an orchestra may be assigned a lower level ofpriority than that of the conductor and librarian. In turn, individualperformers within the sections may be assigned the lowest level ofpriority. Control over communications with other systems is directlyproportional to priority—higher levels of priority provide greatercontrol over communications; lower levels of priority provide lesscontrol over communications. Thus, the librarian or conductor can forcecommunications of information to lower levels, but not vice-versa. Thus,all changes made by the principal violin or viola player can berespectively communicated to all violins or violas, withoutcommunicating also to cellos, basses, etc. Sub-groupings and virtualprivate networks are set-up within the larger communications networkarchitecture of any particular system. For example, a recording studioenvironment includes a recording engineer, a conductor and players,and/or a conductor, principal chairs and librarians. Hierarchies andgroupings of players are respectively determined within the largernetwork. The hierarchical communications can be directly addressablebetween the electronic music stands; broadcast to all music stands;communicated to groupings of music stands identified within groupingssuch as private networks; and/or organized with various prioritiesassigned to master levels and sublevels as necessary.

[0088]FIG. 9 illustrates one embodiment of an LCD display used for inputcontrol and for displaying the information from the processor andmemory. In the preferred embodiment, a touch sensitive LCD screen (990)provides the input apparatus for the user interface, and the performersubsystem enables the functions associated with each displayed button(e.g. 991; 992; 993; 994; 995; 996; 997; 998; 999) to various locationsas appropriate and permits the functions to be changed, and also for thedisplayed buttons to be moved around the screen, depending on thefunction to be activated. The musical score may be edited by theconductor, either by directly drawing via the touch screen, or such asby touching the individual note after which he is presented with anumber of notes to replace the touched note. For example, the lowerportion of the screen displays instruments from which the conductor canselect which instrument will be playing the composition. After a buttonon this screen has been touched, a number of sub-screens may come up,each with their own individual touch sensitive areas and functions to beactivated by those areas. Alternatively, in addition to or instead ofthe touch screen, the system can provide input via separate keyswitches, voice recognition, etc.

[0089] In one embodiment, an output is provided that permits coupling ofan external display, such as a color monitor, projection unit, or otherdisplay presentation system including one or more of audio, visual, andaudiovisual.

[0090] In an alternate additional embodiment, each stand-aloneworkstation provides the capability to function as a master stand-alone,or a master or slave workstation within a workstation set includingmultiple stand-alone workstations, wherein one is designated master andthe rest are designated slaves. The slave workstations in thisconfiguration receive communication of music compositions to bedisplayed from the master workstation, thereby permitting one sharedmusic database to be communicated among all workstations which are apart of the group. It is to be appreciated that the shared musicdatabase function can be distributed in many different ways among theworkstations, or separable from and independent from the workstations.The choice is simply one of design, and the illustration herein shouldnot be taken in a limiting manner.

[0091] The display workstation can be implemented as a totallyself-contained workstation, where each workstation contains its ownprocessing sub-system, communications interface (such as wireless orcable) for network use, input/output interface including one or more ofa user input keypad, a speaker, a microphone, joysticks, push buttons,etc. Each of the stand-alone workstations can then operate with a localdatabase, or couple to a shared music database as illustrated in FIG. 1.

[0092] In one wireless embodiment, an RF antenna can be built into thestand (101; 103). Alternatively, instead of using RF, the performer'sstands can be linked to one another using infrared, fiber optic cable,shielded cable, or other data transmission technologies. As discussedabove, the communications link can be bi-directional, such as tofacilitate requests and responses to facilitate the feedback ofperformance parameters or such that any workstation can be a master orslave, or used in combinations.

[0093] Communications interfaces of various types are well known andcommercially available, and at the present time, they are available forpurchase at the chip, board, or system level from many U.S. andinternational suppliers. In fact, many presently available single chipmicrocomputers include built-in communications interface capabilities,wired and wireless, such as from Intel, AMD, Texas Instruments, Hitachi,etc.

[0094] The instrument output signal permits coupling of the instrumentinput signal, either directly fed through or as modified by theworkstation, for output to the appropriate public address oramplification and presentation system or separate analysis system. Theworkstations are coupled either via wired or wireless communication to aprocessor subsystem (280) that includes a processor, non-volatilememory, read/write memory and an interface to a non-volatile storagemedium (582).

[0095]FIG. 10 illustrates an architecture of plurality of the electronicmusic stand Performer Systems of FIGS. 1-9 (made up of variouselectronic music stand products (800 A-C)) connected by a communicationchannel (801). The network logic (803 A-C) in each productself-configures to the environment it finds itself in (such as using theavailable communication channel (801) and finding other products tointeract with). The communication channel (801) can be implemented byany number of means, including, but not limited to Wired Ethernet,serial, Wireless Ethernet, Infrared, MIDI and USB.

[0096] As illustrated in FIG. 1, a music library (120) is coupled to acommunications subsystem (125) that transmits the contents of requestedcompositions from the remote music library (120) via a radio frequencytransmitter to the processor (115) (in a wireless embodiment thecommunications subsystem uses the antenna (104)). A receiver couples thetransmitted signals to the processor (115). This embodiment enables themusic library (120) to be remote and located at a great distance fromthe requesting site. The antenna (102) at the receiver picks up thetransmitted signal. The communications subsystem (125) can be atransceiver for bi-directional communication, or a transmitter forone-way communication (such as where the requests are otherwisecommunicated to the music library subsystem (120), via wired or wirelessconnections).

[0097]FIG. 11 illustrates an alternate embodiment of the presentinvention. In this embodiment, the workstations are remote units (901;902; 903) used by members of a marching band. Each of the remote units(901-903) is equipped with a respective receiver (910; 911; 912) thatprovide for receipt of communications including receive music datarepresentations of musical selections or compositions transmitted tothem. Remote units controllers (920; 921; 922) control the operation ofthe respective remote units (901; 902; 903). The musical composition isdisplayed on the remote unit's respective displays (930; 931; 932). Thedisplays can be low cost such as an LCD multiple line display providinglow cost, low power usage, and high visibility/readability. Auto AdvanceMode, wherein to compensate for limited display image. The Performersubsystem automatically redefines the music data for adaptive display inslices (as discussed in detail elsewhere herein) to adjust for format,layout and size; and the electronic music stand system provides an thedisplay automatically scrolls as the music is performed.

[0098] Each remote unit (901; 902; 903) can be mounted on the instrumenton or in place of the lyre. The remote unit's antenna (940; 941; 942)can be separate from or built into the remote unit or the lyre. Atransportable main unit (950) is used to transmit musical compositionsto remote units (901; 902; 903). The transportable main unit (950) iscomprised of a controller (906) for controlling the transportable mainunit (950), a music database storage medium (905) containing the datafor the musical compositions to be played by the band, and a transmitter(904) for transmitting (950) via antenna (943) the musical compositionsto the remote units (901; 902; 903). This main unit can be in the formof a suitcase or briefcase size item. The main unit can also be providedbuilt into a van that is driven around with the band or as a smallself-contained portable unit. In accordance with this embodiment, theband can play a virtually unlimited number of musical compositionswithout the problem of carrying the music with them in paper form. Italso relieves the band members of the problems of changing music andchanging pages while marching. As discussed in the above embodiments, inthe performance mode, the musical score is automatically scrolled acrossthe screen display (931; 932; 933). Alternatively or additionally,individual switches can be provided to permit each performer toself-activate, each page turn, or one master (e.g. band leader) canactivate page turns for everyone. Additionally, a keyboard and/ormicrophone can be attached to the transportable main unit allowing theconductor to send messages to the camera remote units via displays (930;931; 932) or via a speaker associated with units (901; 902; 903). Thisallows the conductor to send instructions to the band (such as to take acertain route, or play at different volumes or speeds). Withbi-directional communications and user performance feedback, theconductor can also monitor for errors.

[0099] In accordance with the teachings of the present invention, asystem and methodology are provided for music display presentation andcommunication. Musical compositions can be input to the presentinvention from any one or more of multiple sources, such as frompre-stored score images, live microphone, direct input from musicalinstruments or vocal direct performances, imported from a musiccomposition program (such as Finale, Sibelius, Cakewalk, or Mosaic),other computer data files, MIDI files, a MIDI sequencer, scanning in ofexisting printed score images (as image data or as optically characterrecognized), cameras, visuals, etc. These inputs by the system are usedin the selective storage, composition, communication, and presentationof the musical system of the present invention. The system can generateadditional material automatically, or permit a user to modify,communicate, display and/or reproduce the musical compositions.

[0100] Existing forms of music notation can be converted manually, orcan be converted automatically by scanning in sheet music, using theimage data directly for display, or recognizing (such as by usingoptical character recognition or object oriented coding) the variouselements of the music, and facets and specifics of the syntax in theform of notation including its constants and variables and protocols,and integrating via an artificial intelligence type expert system thatnotates, highlights, and accentuates via synchronized metronoming oftime signature to music. Any of a variety of other means of inputtingand/or converting music can also be used, such as direct input ofmusical performance signals processed via software that converts it intomusical notation. Such software is commercially available, such as fromARS NOVA, Wildcat Canyon Software, Mark of the Unicorn, Inc., MakeMusic, Inc., GVOX, Sibelius, Inc. and Passport Designs, Inc.

[0101] In accordance with one aspect of the present invention, eachelectronic music stand system display workstation can also provide theability to convert performed musical compositions into notated musicalcompositions, generating the appropriate musical notation (e.g., staff,tablature, MIDI), notes, time signature, key, instrument, or user type,etc, and further provides export capability to save and export theelectronic music stand music data file into multiple formats, includingbut not limited to at least one of TIFF, BitMap, JPEG, Postscript, PDF,MIDI, proprietary composition formats for commercial software, and anoptimized custom electronic music stand format.

[0102] Some music is only available in notated forms, where there is notan existing signal showing proper synchronization of the signals. Thus,a controller subsystem (such as (280)) provides for real time conversionand analysis of syntax of the music notation, in conjunction with aprecision clock metronome, and provides an indicator (such as color orother highlighting or bolding or accentuating) of the relative timing ofthe performance relative to a place in the sheet music (or other form ofmusical notation). Alternatively, the user can set a tempo rate, and theelectronic music stand system automatically advances pages based on thetempo rate and a related page turn rate variable that utilizes the temporate. An emergency stop/override button permits overriding the automaticadvance mode.

[0103] Since the music notation is now in computer usable form, it isnow an easy task to communicate, display, compose, alter, and transposemusic (such as in key, for types of instruments or voice parts, andharmonies) via well-known techniques.

[0104] Native data files from Finale, Sibelius, and other music editingor composition programs can be saved and output in one of the aboveformats to be converted to one of the formats compatible with theelectronic music stand, or used in native file format if compatible withthe electronic music stand appliance formats.

[0105] As illustrated in FIG. 8, conversion Services logic (1007)provides conversion of music data from external sources and vice versato and from the format required for the recipient. These servicesconvert the music data from the best available source, optimally for thecurrent need. This conversion can be optimized for speed or quality.Available conversions include: resize images, rotate images, sharpenimages, format changes (e.g., such as between or to TIFF, JPG, BMP, EPS,PS (Postscript), Adobe PDF, etc.) and color/BW (black and white).Referring to FIG. 7A, in conjunction with FIG. 8, a performer subsystem(700) is illustrated comprising a processing subsystem comprising aprocessor (701), coupled via coupling (702) to data storage apparatus(705), and to a communications interface (710) coupled via coupling(704) providing for an external communications interface coupling (711).Session monitor logic (722), coupled via coupling (723), determineswhether the communication interface (710) has an active communicationsession with another Performer Subsystem (200). The state of thecommunication session active or inactive is coupled to processor (701)via coupling (724). The processor is also coupled via coupling (703) toa touch-screen input display (715). Logic within the performer subsystemprovides for “librarian logic” (see (1003; 1010) of FIG. 8) of managingstorage, retrieval and indexing of the music data in the data storageapparatus (705); “performance logic” ((1005) of FIG. 8) defining dataformatting and display responsive to the touch-screen input display andthe librarian logic; and “network management logic” ((1015) of FIG. 8)providing management of communication via the communications interface(710) with an external apparatus responsive to the “performance logic”and the “librarian logic.” In a preferred embodiment, program data (706)is stored in the data storage apparatus (705). The librarian logic(1010), the presentation and performance logic (1005), and the networkmanagement logic (1015) are provided by the processor responsive to theprogram data (706) stored in the data storage apparatus for managingdata formatting, displaying music, and managing communications of datawith the external apparatus. The Performer Subsystem (200) can beimplemented utilizing commercially available all-in-one touch-screentablet computing systems (e.g., such as those available from Advantec,Ltd. (U.S., Taiwan), Acer (U.S., Taiwan), Sony (U.S., Japan), FujitsuComputers (U.S., Japan) and Gateway Computers (U.S.)).

[0106]FIG. 12 illustrates the overall operation by one embodiment of themusic composition communication workstation. It begins by starting upthe system (1200). The system then provides a menu (1201) that allowsthe user to select a listing of available music compositions. The userthen selects one or more compositions (1210). If the user selects onefrom the menu that is locally stored, it directly retrieves theinformation. Alternatively, if it's not something locally stored, thesystem couples (e.g. will dial up or go through a database or network)to a remote storage site and requests and receives the selectedcompositions. Any changes that are desired to the composition can beselected at the next logic block (1215). If there are changes (such asto the key, or note editing, or selection of form of display orinstruments), then those can be accomplished as illustrated at blocks(1255) change key; (1260) select new key; (1265) transpose; (1270) edit;(1275) conform to edit; (1280) select instrument(s); (1285) generateadditional scores for selected instruments.

[0107]FIG. 13 illustrates a functional/logical block diagram for oneembodiment of the present invention, illustrating both structure andstate flow for start up and operation of the electronic music standperformer system in one embodiment. At initialization of the system(step 601), the program data in the data storage apparatus is executedby the processor to go through system start up, loading of theelectronic music stand system's operating system, set up of parameters,and loading of the electronic music stand appliance application programand data. Upon completion of the set-up (step 605), receipt ofcommunications (step 606) is provided via the communications interface(step 616) such as via external USB coupling (step 616), externalEthernet coupling (step 617), external serial coupling (step 618)wireless communications coupling (step 619), or other coupling via thecommunications interface.

[0108] Referring again to FIG. 7B, two Performer Subsystems (200-A;200-B) are shown illustrating the bi-directional communications (220)between the two Performer Subsystems. Responsive to the set upparameters, communications input from the communications interface (step615), and external user input (step 609) from the user interface, andfrom the set up (step 605), the Performer system proceeds through set upmodes and from there to selection of processing modes (steps 655; 660;665; 670) as discussed hereinafter. Alternatively, the set up screenmode can select to go to the home screen mode (step 610) which thenoperates as described hereinafter.

[0109] Upon completion of system set up, the user interface process isimplemented (step 610), which provides a home page display, and whichlooks for an external user input (step 609) such as an input providedthrough the touch input screen display (or such as via a writing tabletor mouse or footswitch). The system defaults to initial start state ifno external user input is provided, such as displaying the first page ofa defined music selection, or providing a home page display withoptions. Decision logic responds to the external user input selection tofurther determine an operation mode (step 660). Responsive to theselection (step 660), this system either enters the Options Mode (step670), the Music Mode (step 680), the Librarian (Music Selection) mode,or the Shut Down Mode (step 650). From the Music Display Mode (step680), the system operation proceeds to one of edit mode (step 620),Navigation Mode (step 630) or Performance Mode (step 640). The edit mode(step 620) (or Draw Mode) permits for the user to provide edits to theimage data being displayed, and to save various levels of revisions.

[0110] As illustrated in FIG. 13, a shut down (step 635) can be selectedby the user via the external user input (step 609), which causes theperformer system processing subsystem to implement a shut down procedureto shut down the electronics and computing technology and shut off thePerformer system.

[0111] Further options can be selected such as determining how theappliance shuts down, prompting for saving changes (e.g. on time cycles,on events, per user selection, or automatically saved), page-turntransition options, contrast/brightness selection and/or remote control,appliance Identification, etc.

[0112] Referring again to FIG. 8, the Network (1015) Discovery andIdentification logic (1020) allows the appliance to identify itself onthe network and discover other users and appliances on the network. Theappliance, at a regular interval attempts to make itself known on any ofits available networks. This is done so as not to interfere either withthe network itself or significantly affect the operation of theappliance.

[0113] Once the appliance has successfully identified itself on thenetwork, it proceeds to discover the other Electronic Music PerformerSystem and subsystem appliances on the network.

[0114] In a pure peer-to-peer scenario, the appliance has storedinformation regarding the passwords, groups and other informationrelating to the user and what other users and appliances will haveaccess to resources on this appliance. This option is more suited forsmaller and/or less permanent situations.

[0115] Alternatively, the authentication is done in conjunction with acentral server that contains information about multiple users and theirpasswords, groups and other related information. This information canthen be managed by a common administrator and the user is not restrictedto use a particular appliance. This option is optimal for use by largergroups such as orchestras. The central server can also provide a centralrepository of music data, and a database for revisions.

[0116] The Performer Systems and subsystems can operate in two networkedmodes: peer-to-peer and central server. In the peer-to-peer mode, eachPerformer System or subsystem defines the authorizations that it willallow and must define which groups of Performer Systems with which itwill communicate. In the server-managed mode, the central server definesthe Performer System's and subsystems authorizations. The central serverconfiguration allows a user to move from one physical system to anotherand retain set-up preferences, while the peer-to-peer configurationrestricts the user to the set-up preferences selected on each individualsystem. The central server configuration requires that all users ofPerformer Systems and subsystems be registered and managed by a commonnetwork administrator. The peer-to-peer configuration allows each userdefine his own set-up preferences without a centralized server oradministrator privileges. However, the user may copy, save, import andexport user preferences, regardless of network configuration.

[0117] Referring to FIG. 14, an alternate embodiment of the presentinvention is provided where one or more workstations (105) include, at aminimum, a display of the music notation. These workstations are coupledto a master music communications controller (415) that provides for aseparate user input (411) which provides input interface, such as to aMIDI stream, computer data links (such as RS232, modem data link) etc.,that designate requested musical compositions, transformations, anddisplay requests for various ones of the coupled workstations.

[0118] The multiple connected workstations can operate as stand aloneworkstations using their local intelligence for displaying downloaded orresident music compositions. They can also interact in a master/slavelinked environment, where one of the master workstations ((300) of FIG.3) asserts a master status, and all other inter-connected workstations,whether workstations (105) or master/slave workstations (300) operate ina slave mode coupled to the designated master. Additionally, masters cancommunicate between each other for a master/master networkconfiguration.

[0119] The advantages of electronic music composition, orchestration,communication and display are many. In addition to those discussedelsewhere herein, a capability exists for expert system based artificialintelligence type assistance, where the expert system assists in many ofthe functions performed in musical composition and performance. Forexample, in the Auto-Compose Mode, if the words need to be changed tomatch the meter, equivalent terms can be chosen from the many sourcessuch as a thesaurus, dictionaries, rhyming dictionaries, encyclopedias,etc., to assist as well. Phrases from poetry, selected and indexed bycontent or topic can be re-expressed to create new works. Drum andrhythm section accompaniment can be expertly suggested, as well asharmonies, melody lines to accompany chords, chord progressions toaccompany melodies, harmonies to accompany a melody, and suggestedmusical instrument groupings to support a particular sound, rhythm,style, tonal quality, etc.

[0120] The system can be designed to take advantage of expert systemdesign knowledge. A database of rules and facts are provided, andadditions and modifications are accumulated over time by the system in aself-learn mode. The expert system itself has the necessary logic toprobe the user, monitor the performance, and apply the rules to providefeedback and reports to the user of skill level, errors, automatedperformance display, etc., starting with a base defined set of rules,instructions, and a knowledge database specific to music.

[0121] Referring again to FIGS. 1 and 14, the workstations (105) accessthe music database storage means (420) that provides the data for therequested music composition via the master controller (415). The mastercontroller (415) displays both the requested music composition as wellas user interface communication for the music communication system to bedisplayed on either a dedicated display (416) or on one of theworkstations (105) as designated by the master controller (415). Themusic database (420) can either be local, or can be via a data link(e.g., phone line, RF, cable, satellite, otherwise).

[0122] Referring again to FIG. 8, the Network Communication Protocolslayer logic (1002) manages the various network and communicationprotocols and physical and logical interfaces used to communicatebetween appliances. The selection of network, both physical andprotocol, is made as transparent to the user, and as self-configuring,as possible.

[0123] Referring still to FIG. 8, a user (1001) provides a user inputvia the touch screen (1051) which provides a signal to the DisplayInterface Logic (1009) presentation layer of logic (1005), whichprocesses the signal appropriately. Graphical User Interface (GUI) logicand respective processing logic are provided for user interface(touch-screen (1051) and Display (1052) with the Network (1015) andLibrarian (1010) layer logic.

[0124] As illustrated in FIG. 10, the illustrated fundamental ElectronicMusic Performer System logic software architecture consists of threelayers, Presentation (1005), Librarian (1010) and Network (1015). ThePresentation Layer (1005) provides control logic and user interface forall the direct interaction with the user. This layer is the mostaffected by operating system changes and hardware characteristics suchas screen size. The Librarian Layer logic (1010) provides the managementof information within the Performer system including, but not limited tothe selection of the music, notations on the music, user information andproduct state. This layer can also manage any necessary copyright orrights management. The Network Layer logic (1015) provides thecommunication between various system products. In a preferredembodiment, the communication is mostly self-configuring and providesfor a hierarchical and direct communication scheme.

[0125] Referring again to FIG. 8, the Groups and Authorization layerlogic (1021) manages the group assignments of individual appliances to agroup and necessary authorizations. Once the appliance has progressedthrough the discovery and identification (1020) steps, it needs todetermine its groups and authorizations (1021). The first stepauthorizes the user. The user identifies himself through the Network GUI(1002) with a name and password. The password is preferablyauthenticated.

[0126] Many methods and protocols are utilized in accordance with thepresent invention for implementing user interface to make the electronicmusic stand user-friendly and comport to protocols and conventions ofsheet music to ease the transition in use by musicians. For example,there are the protocols for implementing page turns, e.g., by touchingthe right screen (or right side of a single screen system) to go forwardand touching the left screen (or left side of a single screen system) togo backwards, implementing footswitches to eliminate the need for use ofhands, to turn pages of the music, and positioning of selection softbuttons on the space screen.

[0127] When in the navigation mode, the display of the music dataoperates in a similar manner to the Music Display mode, except that theactual music display is physically smaller to accommodate leaving spacefor display of the buttons, and permits drawing, other editing, andnetworking.

[0128] The Network GUI (1002) layer logic provides user interaction withthe Network layer logic (1015) for the network operations.

[0129] Referring again to FIG. 1, the music workstation stands caneither be identical or broken down into conductor stands and performerstands. A conductor stand (105CON) usually has more functions andcontrol than a performer stand (105PER). A performer stand (105PER) canrange in capability, from only having the ability to receive and displaymusical scores, to full featured such as the conductor stand (105CON)that has the ability to select the musical score, change the key of themusical composition, and perform other tasks that usually a conductor orlibrarian would be permitted or required to do.

[0130] In one embodiment, the master workstation (300) has completecontrol over the slave workstation (105). Anything displayed on themaster workstation is also displayed (at the master's selection) on theslave workstation. It is also possible for the user to select or maskcertain portions of the display of the master workstation before it isdisplayed on the slave workstation. In this manner, the conductor, usingthe master workstation, can select and transmit to the slaveworkstations only that information that is required by the orchestramembers.

[0131] The conductor and performance mode operations can also becombined. The workstation can also be enhanced to provide training andcomparison of a user's performance to the displayed actual music. Anycommunications channel used between (e.g. intra-communication in alinked set) Performer Subsystems can be used to communicate betweenPerformer Systems (inter-communication). The communication can be usedto transfer music notation, go to a bookmark, transfer drawing, senddata files, or send general messages between Performer Systems. Anetwork graphical user interface (GUI) (see (1002) of FIG. 8) conveysuser input to allow for the set-up and management of the communicationswith other Performer Subsystems. The network GUI provides for definingthe network, specifying user names, specifying appliance names, andsending messages to other Performer Systems on the network. EachPerformer System broadcasts its identity to all Performer Systems on thenetwork. A Performer System on the network listens for new PerformerSystems and adds the new systems to its known list of systems availableon the network. A Performer System on the network can send messages toand receive messages from other Performer Systems. These messages cancontain music data, control data, permissions, text messages, images,etc.

[0132] As an example, if the conductor touches the transmit key on themain screen, he will be presented with a screen showing all of theinstruments that he has selected for that piece and a button labeled“ALL”. He may now transit to any one (or group of) individual musicstand or by touching the “ALL” button area, transmit to the entireorchestra.

[0133] In the performance monitor mode, for a single user or multipleusers, the user (or a remote teacher or conductor) can indicate the rateat which he feels the performer should be performing or the system canoperate at a default rate, or the music data can set the rate, or thesystem can set the rate based upon the user's initial performance. Amicrophone input or live input on the music workstation samples theuser's actual performance and permits providing a graphical display(e.g. mapping) (for the user or teacher/conductor) showing the relativesynchronization of the performer's actual performance versus theconductor's desired performance.

[0134] With use of appropriate sound baffling, a plurality ofinstruments can simultaneously be monitored and controlled by theconductor (or teacher), so long as each instrument's output soundpattern is communicated directly to a respective workstation. The outputof each of the workstations can then be coupled to the conductor's (orteacher's) master workstation for further analysis and processing.

[0135] The user's performance can be compared to the score, and feedbackcan be provided to the performer and/or teacher or conductor as to thequality of their performance.

[0136] In an alternate embodiment, the slave workstation communicatesperformance parameters or deviation signals to the master workstation,for error analysis feedback.

[0137] Referring again to FIG. 8, the Message Handler layer logic (1022)manages the messages sent to and from other appliances. For variousreasons, an appliance may want to send information to other appliances.The message handler will set up a session between the appliances andsend one or more messages. When communications of messages is done, thesession is closed. Both appliances are able to close the session and theother is able to detect the closing of the session. The session can alsobe closed by the failure of the network, which in a preferred embodimentis detectable by both appliances.

[0138] Preferably, the communications of changes made by the conductorare provided to facilitate process flow in the same manner as when papersheet music is utilized. Thus, when a conductor makes a change, theperformer system used by the conductor communicates the image data forthe screen image representing the conductor's change, which iscommunicated to the appropriate principal such as the concert master, orprincipal cello, etc. In one embodiment, the concert master sees thescreen image for the conductor's change as a picture in picture on theconcert master's local performer system display, and is able tosynchronize the local display to the same appropriate page correspondingto the change made by the conductor, and make the actual change on themusical part for the violin corresponding to the change the conductormade in the score. Then, the principal or concert master (asappropriate) makes the changes manually and edits locally on hisrespective performer system. Changes by the concert master arecommunicated as image data to the performer system music stands in theprivate network associated with the principal or concert master. Thechanges can be either automatically implemented as an overlay onto theindividual performer system's music stands within the private network,or they can be displayed and flashed on the appropriate area of theindividual musician's music stand to permit the local user of thatperformer music stand to accept the changes and implement them onto theuser's music stand. Alternatively, software logic can be provided in theconductor's or the librarian's system to permit changes made by theconductor or librarian to automatically be converted from score toindividual parts and thereafter be communicated to the individualstands. As a third alternative, the conductor's changes can be forwardedto the librarian, who can then implement communicating changes to theindividual parts.

[0139] Revisions made on one performer system can be communicated asdirect overlays to be displayed on selected ones of the other PerformerSystems—shown as an overlay atop the image data otherwise displayed onperformer system to which the revisions are communicated. Alternatively,a picture-in-picture image of the revised section may be communicated,permitting the receiving Performer Systems user to determine whether ornot to make the change. The original, and all revision layers arepreferably saved and accessible via the Music Selection Librarian logic.As previously discussed, communications can be via wired or wirelessmedium, and can include other Electronic Music Performer Systems as wellas other general computing systems utilizing appropriate interfacesoftware.

[0140] The sessions can be set up in a one to many (broadcast) and/orone to one (direct) relationship, and/or multicast. Due to the nature ofthe sessions, some may exist only to send a single message and others tosend multiple messages. The session is one-way, e.g., data istransferred in one direction except for a simple acknowledgement thatthe transfer was accepted, failed or was rejected. Bi-directionalinformation flow requires at least two sessions.

[0141] An appliance has the right to reject a message for any reason andthe sender appliance properly handles a rejected message. A message isrejected because (1) the appliance does not respond to a particularmessage, (2) the external user or appliance does not have the accessrights to send this message to this appliance with this user, or (3) theappliance is simply unable process messages or its too busy.

[0142] Messages contain some or all of the following information: sumcheck, message size, message version (to allow for future enhancements),sending appliance, sending user, receiving appliance, receiving user,message type, message payload size in bytes, message payload, etc.

[0143] Referring to FIG. 15A, the operation of the automated mode “AMode” (1240) is illustrated. First, the user selection of the desiredautomatic mode is detected and responded to, illustrated as theauto-advance mode (1242), the training mode (1244), the performance mode(1246), or any one of a number of other modes (1248) as is described infurther detail hereinafter. For example, auto repeat mode can beselected by designating the start and stop points, and the number oftimes to repeat a “looped” portion (or portions) of the displayedmusical composition. Marching band mode (auto-advance based on metronomefunction, conductor control, etc), auto-compose mode, and many otherscan also be implemented. The order of selection of auto-advance,triggered mode, or performance mode is arbitrary, and the user canalternatively decide from a menu where all are simultaneously presentedas choices.

[0144] Referring to FIG. 15B, the automated mode “A Mode 2” (1244)operation of FIG. 15A is illustrated corresponding to the training mode.In this mode, the system tracks the performance (1280) of the individualuser to the composition score, primarily for the purpose of permitting acritical analysis and comparison of the performance to the score (1282).This analysis determines divergence from the selected musical score, andreveals errors or deviations from desired performance goals (e.g. matchof timing of notes, duration of notes, pitch of notes, etc.), and todisplay those errors (1284) (such as by audio or video means).Predefined performance goals provide the knowledge basis for expertsystem based analysis.

[0145] The system can then generate a graded score (1286) indicatingerrors, and can present it in numerous formats such as histograms,frequency of errors, spacing of errors, etc. Identification of when theerrors occur (e.g., only when going from slow to fast, or fast to slow),absolute position within the score and so forth, are also tracked andreported. Other expert system rules can be provided by music teacherswhich give the necessary parameters for modeling expert systemreasoning, as well as guidance and suggestions on how to correctproblems such as via display text, graphics, audio, etc.

[0146] The comparison of the performance to the score in the trainingmode is for the purpose of detecting the performer's compliance toparameters (such as the tempo, rhythm, filter, parameter, pitch,tonality, and other features that are adaptable or can be modified byperformers). This parameter information is available and published innumerous forms. Thus, having provided this core set of parameters, thesystem can thereafter perform the training automated mode.

[0147] For all automated modes (e.g., A Modes 1, 2, 3, 4), trainingfeedback can be provided real time or subsequent to performance ateither or both of the performer's workstation and a second (e.g.,teacher's) workstation.

[0148] Each Performer System has a Librarian GUI that manages the musicnotation data on its local storage and on remotely accessed systems. TheLibrarian GUI provides an interface for the user to import music andother data to the Performer System. The music data or other data on anexternal storage device may be provided from a removable storage device,e.g., a USB RAM disk, removable media (i.e., a CD-ROM), or via a networkcommunications channel from another Performer System or file server.Music data contained within an external storage device may be importedto the Performer System which thereafter performs the necessaryprocessing or manipulations of the data optimizing the music data fordisplay in the Performer System.

[0149] The Librarian logic portion of the Performer System maintains anappliance state to retain user selections and preferences after theappliance is turned-off.

[0150] The librarian function provides for coupling of datacommunications (through the communications interface) of music data andother data for storage in the data storage apparatus of the performersubsystem, and may be accomplished via physically differentcommunications channels, or via a single common channel. As illustratedin FIG. 7C, the management functions of the communications between themultiple Performer Systems (e.g., (100; 200; 300; 400) can be managed bycentralized controller (730) or distributed among a plurality of thePerformer Systems. Any number of Performer Subsystems can be combined toform one Performer System (740). The centralized controller (730) can beimplemented with a performer system or by a separate computing system.

[0151] In a preferred embodiment, the Librarian function of thePerformer System receives music notation data in objects (as well as inimage data files). The objects can be as small as a single note or staffline. The objects can be standardized (such as MIDI, Finale files,Sibelius files, Mosaic files). The objects can also be custom, such asfrom a Synthesizer, a computer, or proprietary objects created andoutput from the Performer System. The Librarian function can provide theexact amount of information to fit on the display as needed. However,depending upon the file format, the provided music data object may notentirely fit on the display, so only a portion of the page is displayed.The Librarian GUI provides a method to divide pages into smallersections—allowing horizontal and vertical slices. The sections arelogically and sequentially ordered from top to bottom and then left toright. Thus, the leftmost section of the top slice is the first logicalsection proceeding to the rightmost section of the top slice and thenultimately to the rightmost section of the bottom slice.

[0152] Referring again to FIG. 8, the Librarian GUI (1003) layer logicprovides control of user interaction with the Librarian layer logic(1010) for the librarian operations. This GUI (1003) provides the userwith controlled interaction with the Music Storage logic (1004) in theLibrarian Layer (1010). Any data format conversions can be automaticallyhandled by the Music Storage logic module (1004), which automaticallycalls the Conversion Services logic (1007) as needed.

[0153] The Librarian Layer logic (1010) is comprised of Appliance Statelogic (1008), the Music Storage logic (1004) and Conversion Serviceslogic (1007).

[0154] The music data describing the music notations can be stored onthe Performer System displaying the data, or it can be obtained from anexternal source, such as an external server, external storage, oranother Performer System that may or may not be shared with other onesof the Performer Systems. Each Performer System provides the control toretrieve, process and display the music data. Each Performer System cancontrol none, one or more displays. When no display is connected, thenthat Performer System is used to share information and/or provide acontroller for use with other Performer Systems.

[0155] The Music Storage layer logic (1004) controls the storage of themusic data operations on the current resident appliance and coordinatesthrough the network layer (1015) with other Performer System appliancesand any coupled servers on the storage of music data.

[0156] A list of available music scores stored in the music storage canbe selectively activated for display as bookmarks. The electronic musicstand appliance can store more scores than are actively used anddisplayed. The Librarian logic (music selection logic) provides forordering, importing, exporting, and setting active/inactive status foreach musical composition. This reduces the clutter of displayingbookmarks and in locating a particular page of stored music, such aswhen the appliance is being used in rehearsal or performance. When ascore is activated, there may be a need for a conversion process in theconversion services module (1007) if a different orientation or size fordisplay of the music is selected or required. This conversion varies inlength of time required, and takes longer times for long scores. Once aconversion is completed it is stored in the appliance and it doesn'tneed to be converted again. However, the storage of these conversionsconsumes storage space in the Music Storage of the appliance. Therefore,depending on storage capacity and user needs, unneeded configurationscan be deleted (1004) to save space, or exported for archival, and thendeleted.

[0157] The music storage layer logic (1004) provides the user theability to delete the selected portions of music from the appliance'smain music storage. It can also export and import music into musicstorage spaces. These spaces can be found on the Electronic MusicPerformer System appliance or network, or by physically attaching aremovable storage media (e.g. Flash RAM, floppy disk, hard disk, CD ROM)to the appliance. In certain embodiments, the current applianceadditionally needs to have the permission to read or write informationinto that space.

[0158] Referring again to FIG. 7A, in accordance with one aspect of thepresent invention, image data from the Data Storage Apparatus (705) isprovided to the Performer Subsystem for utilization by the processor(701) to generate a display on the touch-screen display (715), formattedand presented as a human recognizable display of the music data. Theimage data is not limited to music data, and can be applied to othersorts of visual data being utilized for other applications by thePerformer System, including scripts, video imagery (such as how to play(ala the Suzuki method, or a teacher illustrating a role model)), or foruse by a stage hand or lighting technician, or sound engineers, orrecording studio related information, text announcements, etc.).Depending on the source of the music image data, the performer subsystemselectively provides signal processing of the music image dataresponsive to the Data Storage Apparatus (705), to improve thereadability of the displayed images, as well as providing for formattingof the image data to the appropriate screen resolution and size of thedisplay of the performer system. Any of a plurality of image processingalgorithms can be utilized as set forth in Digital Signal Processing(Stanley, William D. Digital Signal Processing. Reston: RestonPublishing, 1975.) and Programs for Digital Signal Processing (—Programsfor Digital Signal Processing. Ed. W. R. Crone. New York: IEEE, 1979.)

[0159] Additionally, the Performer Subsystem (200) provides for cachingand buffering of the music data, and where appropriate, the signalprocessing of the image data, and provides for memory mapping controland management, to utilize the music data stored in the data storageapparatus (705) of the Performer Subsystem (200) to provide to the usereffective real time display, advancement and page change of the music.The caching and buffering eliminates the delays that would be incurredin going to and from slower large storage such as hard disk or Flash RAMor CD-ROM, to higher speed RAM, by pre-loading a portion (the cache) ofthe higher speed memory (e.g., RAM) in accordance with defined cachemanagement for use by the processor in the performer subsystem (200). Ina preferred embodiment, each performer system would save an image of themusic page in the short-term cache (e.g., high speed RAM) of the DataStorage Apparatus (705) shown in FIG. 7A. The processor (701) calculatesthe next most likely pages that the user may request to display. Theprocessor then reads the music page information in the long-term area,typically a hard drive or flash ROM, of the Data Storage Apparatus (705)and transfers it to the short-term cache performing any transformationsof the data to prepare it for subsequent display. When the user requestsa new page to be displayed, the page advance/turn process is increasedin speed since the information has already been preloaded.

[0160] The Presentation GUI ((1005) of FIG. 8) displaying the music dataevaluates the music data to find the largest logical section, after theuser has defined the slices and logical ordering as previouslydescribed. The largest logical section defines the scale for theremaining logical sections to be displayed. Therefore, page-size andpagination of the musical score is pre-defined by the user's selectionof section slices and logical ordering. So, while the system appears tobe advancing or returning pages, it is actually advancing the musicalscore by the user-defined number of image slices and logical ordering.

[0161] In a preferred embodiment, the providing for the display of themusic is further comprised of: providing for the selective variation ofsize and orientation; defining a display width and display height forthe display to be used for display of the music; selecting from thelogical sections to determine a best fit to the display width and thedisplay height responsive to the mapping and storing; and displaying theselected ones of the logical sections on a video display to provide abest fit responsive to the selecting. As illustrated herein, the displaywidth equals a maximum width for the display and the display heightequals a maximum height for the display, where both the display widthand display height maximum width and maximum height are positiveintegers.

[0162] The default ordering of the sections of music is defined by thesource of the music. For scanned music, this is the pages of music. Formusic from an editing program, this could be the sequence of measures inthe score or even the individual notes. As defined above, the user couldsubdivide these into sections which are then displayed on the screen.However, music can have various types of repeats, codas and other jumpsin the music so it is not always performed in a strictly linearsequence. Thus the sections can be logically ordered and displayed inthat order rather than default physical order. This allows the musicianto always “page forward” during a performance. This is especially usefulwhen the jump would require more than one or two page jumps.

[0163] The order of slicing and creating sections is optimized fortraditional music notation. However, if displayed data, i.e., lyricsonly, is in a language that is traditionally ordered and read in adifferent direction, then the order of slicing and logical ordering willbe changed to be accommodate that layout for data display.

[0164] As illustrated in FIG. 16, in accordance with one aspect of theinvention, a methodology and system is provided for processingstructuring music image data and bookmarks and text related torespective bookmark, as described hereafter. First, the music image datais analyzed (step 1110) and parameters are set defining the music imagedata into defined pages (step 1120). Preferably, each page relates to agiven display resolution and size. Next, the system defines first slicesof the music image data for the first orientation (step 1130), such asvertical. Next, the system defines second slices of each of the firstslices (step 1140) to define logical sections ordering the slices frombeginning to end (step 1150). In a preferred embodiment, the secondorientation is horizontal. Thus, the system orders the first slices frombeginning (top or vertical) to end (bottom or vertical). And finally,the system orders the second slices from beginning (left side forhorizontal) to end (right side for horizontal). In an alternateembodiment, the first and second orientations are flipped, and themethodology and system still apply.

[0165] Having now defined the slices, the system next defines thedisplay width and height (step 1160). Based upon this, the systemprovides for selecting from the logical sections to determine a best fitto the display width and the display height (step 1170). Finally, basedon the processing to determine the best fit responsive to the selecting,the selected ones of the logical sections are displayed on a videodisplay (step 1180).

[0166] In a first embodiment, the first orientation equals vertical, andthe second orientation equals horizontal, where the beginning equals topfor vertical, where the end equals bottom for vertical, where thebeginning equals left side for horizontal, and where the end equals theright side for horizontal. In an alternative embodiment, the top versusbottom, horizontal versus vertical, and right versus left orientationsare reversed.

[0167] The method continues with ordering the first slices frombeginning to end; ordering the second slices from beginning to end;mapping and storing the first slices, the second slices, the logicalsections, and the ordering of the first slices and of the second slices;and providing for the display of the music responsive to the mapping andthe storing.

[0168] In accordance with one aspect of the present invention, thevideo/visual display of the music data is automatically sized by thesystem to fit the size and resolution of the display apparatus, or in alinked set of the plurality of display apparatus cooperatively workingin the linked mode.

[0169] The system can automatically paginate the music data for aselected composition, such as based upon embedded pagination orbar/measure count data, or in accordance with a defined criteria logicfor pagination. Alternatively, a user of the system can manually orsemi-automatically select pagination (or define the selection criteriatherefor). The best fit, auto-sizing is provided (by the system of thepresent invention) in accordance with defined music auto-sizing logicand methodology.

[0170] In one embodiment, a method for providing an auto-sizing displayof music from a music database is comprised of first defining a page ofmusic image data from the music database; then defining first slices ofthe music image data for a first orientation; and then defining in asecond orientation second slices of the first slices to define logicalsections.

[0171] An alternative method for providing for video display of musicstored a music database in described in FIG. 23. After pages have beenloaded in the database they are prepared for display (2300). The pagesare ordered in processing block (2301) so as to be in logical page orderin correspondence to their page numbers or some other ordering asdesired. Processing block (2302) gets the first page. If found, theprocessing block (2303) defines the 1^(st) slices. Typically this isdone by creating horizontal slices as shown in FIG. 24. The page (2401)is divided into three 1^(st) slices (2410; 2420; 2430). Any number of1^(st) slices can be defined. The processing block (2303) may performthis function by obtaining user input to describe the break pointsbetween the 1^(st) slices, obtain previously stored informationassociated with the current page or automatically find horizontal lineswhich cross blank portions of the page. Processing block (2304) obtainsa 1^(st) slice. If a next 1^(st) slice is found, processing block (2305)defines 2^(nd) slices. The processing block (2305) may perform thisfunction by obtaining user input to describe the break points betweenthe 2nd slices, obtain previously stored information associated with thecurrent page or automatically by finding measures in the music.Processing block (2304) obtains the next 1^(st) slice and processingblock (2305) defines 2^(nd) slices for each 1^(st) slice. A typicalcompletely sliced page is shown in FIG. 25. 1^(st) slice (2410) is shownto be divided into three 2^(nd) slices (2511; 2512; 2513). 1^(st) slice(2420) is shown to be divided into two 2^(nd) slices (2521) and (2522).1^(st) slice (2430) is shown not divided further and only one 2^(nd)slice (2531) is created. When no more 1^(st) slices are found inprocessing block (2304) the next page is obtained in (2302) and issimilarly processed by blocks (2303; 2304; 2305). Processing block(2302) transfers to processing block (2306) when no further pages areavailable.

[0172] Processing block (2306) orders the 2^(nd) slices by theircorresponding page ordering as defined in processing block (2301).Processing block (2307) orders all the 2^(nd) slices within a page bythe first orientation. In the example shown in FIG. 25, the preferredordering is from top to bottom. 2^(nd) slices (2511; 2512; 2513) wouldbe first, but in no particular order. 2^(nd) slices (2521; 2522) arenext but in no particular order. Finally 2^(nd) slice (2531) follows.Processing block (2308) then orders the 2^(nd) slices within a page and1^(st) slice grouping. In the example shown in FIG. 25, the preferredordering is from left to right. The order of the slices are nowcomplete. In FIG. 25, the ordering of the 2^(nd) slices in an examplepage is (2511; 2512; 2513; 2521; 2522; 2531).

[0173] Logical groups of 2^(nd) slices are created in the next set ofprocessing blocks. Processing block (2310) creates an empty logicalgroup. Processing block (2311) gets the next ordered 2^(nd) slice, frombeginning to end, as defined by the output from processing block (2308).If a 2^(nd) slice is available, processing block (2312) determineswhether this 2^(nd) slice will fit on the display along with the other2^(nd) slices in the logical group. If it will fit, the 2^(nd) slice isadded to the logical group in processing block (2313). Processingcontinues to (2311) where the next 2^(nd) slice is retrieved. Processingcontinues in a similar manner until one of two conditions occur: First,the processing block (2312) may determine that the 2^(nd) slice cannotbe added to the logical group. Then processing continues to processingblock (2309) which stores the logical group in a sequentially localstorage. Then an empty new logical group is created in processing block(2310) and the process repeats as above. When processing block (2311)can find no more 2^(nd) slices to process, the current logical group ofis stored sequentially in block (2314) in a similar manner and in thesame local storage as processing block (2309). The processing block(2315) is now available to display the logical blocks of 2^(nd) slicesin the order stored in memory.

[0174] There may be bookmarks associated with various locations on thepages. It is impractical to show every bookmark located in the system soonly the selected bookmarks are displayed. FIG. 26 illustrates onepreferred embodiment for selecting the bookmarks for display. Theprocess starts at step (2601). The next step is (2602) where thebookmarks are ordered in the same order that the logical groups arestored in processing block (2315). Every bookmark has an associatedlocation on a page so a bookmark can be associated with a logical blockbecause the bookmark falls within the area covered by the logical block.Starting with the first bookmark, step (2603) determines whether thebookmark exists. Assuming it does exist, the bookmark is checked todetermine whether it is a composition bookmark in step (2604). Bookmarkscan be of many types, such as a composition bookmark, a section bookmarkor a simple bookmark. A composition bookmark indicates the beginning ofa composition. All following logical blocks are assumed to be part ofthat composition until another composition bookmark is found. A sectionbookmark is the beginning of a section within a composition and allfollowing logical blocks are assumed to be part of that compositionuntil another section bookmark or a composition bookmark is found. Asimple bookmark is only associated with the logical block it isassociated with. If the current bookmark is a composition bookmark thebookmark is added to the display list in a red oval-shaped button instep (2605). Otherwise, the bookmark is checked in step (2606) todetermine whether it is a section bookmark. If the current bookmark is asection bookmark the bookmark is added to the display list in a yellowarrow-shaped button in step (2607). Otherwise, the bookmark is checkedin step (2608) to determine whether it is a bookmark associated with alogical block within the current displayed section. If it is, it addedto the display list in a green rectangular-shaped button in step (2609).Otherwise, the bookmark is checked in step (2610) to determine whetherit is a bookmark associated with the currently displayed logical block.If it is, it added to the display list in a black rectangular-shapedbutton in step (2611). Otherwise, the next bookmark is obtained in step(2603). In addition, once completing steps (2605), (2607), (2609) or(2611) the next bookmark is obtained in step (2603). This series ofsteps repeats itself until no more bookmarks are left to process and theprocess completes at step (2612) where the selected bookmarks are readyto display. Other choices of colors and user interface structures can beselected consistent with the present invention. The decision is one ofdesign choices for assisting in the communication of relativeimportance, spatial orientation and proximity, etc.

[0175]FIG. 27 illustrates the logic and flow for event processing. Eventprocessing is started in block 2701. Block 2710 waits for an event tooccur. An event is created in response to an action affecting some partof the system. Examples of events include a presentation event of alogical block, selection event of a bookmark, and the creation event ofa logical block. There are many events possible and only some of theevents in the system should start a defined operation. This is done bycreating an association between an event and a defined operation foronly a subset of all events. Some events may not be associated with adefined operation. Block 2720 determines whether a defined operation isassociated with the event. If there is no association, control returnsto 2710 to wait for another event. If an association is found, block2730 causes the actions in the defined operation to occur. After thedefined operation is complete the system returns to block 2710 to waitfor another action. Examples of actions include: a logical group ispresented, the user selects a specific area of the display, a logicalgroup is created, or the presentation an object. A logical group iscreated when it is stored in local storage (2309, 2314). A definedoperation will cause a specific set of actions to occur in some part ofthe same system or another autonomous system. An example of a definedoperation has a first action to create a new logical group and a secondaction to present the newly created logical group. The previousexample's defined operation could have an association with a selectionevent of a bookmark. Another example of a defined operation includesonly one action to present a logical group. The previous example'sdefined operation could have an association with a creation event of alogical block. A third example of a defined operation has a first actionto present the first object in the bookmark information contained by abookmark, a second action to present the second object and furtheractions as needed to individually present the remaining objects untilall the objects are presented. The previous example's defined operationcould have an association with the presentation event of a relatedlogical block. These actions could create other events which in turncause other actions to take place. The design of events must becarefully double-checked so that any particular event does not create anever-ending cycle of events where the event causes an action to takeplace which causes the same event to occur again and again.

[0176] A bookmark is related to a specific location (2440) of an image(2401) and contains bookmark information that provides special detailsimportant to the system or the user that can be used to make decisionsor provide information to the system or user. Images are represented bydata that provides information regarding the visual representationtypically using a rectangular grid of coordinates to represent thelocation within the image. An image can be represented in many ways. Forexample, every point on a rectangular grid may be specified or lines andother symbols, such as letters, can be placed in the image using therectangular grid. A specific location uses the same grid of coordinatesto relate a bookmark to the image. Logical groups are created from acollection of sections from a set of images. A related logical group isassociated with a bookmark because the specific location of the bookmarkis contained within one of the collection of sections in the relatedlogical group. For instance, slices 2511, 2512, 2513, 2521 and 2522could be combined into a logical group and 2531 combined into anotherlogical group. The latter logical group would be the related logicalgroup with respect to bookmark 2440. When a user selects a specific areaof the display 2550, all items that are presented to the user in thespecific area are selected. This would include a bookmark whose locationis within the specific area of the display associated with a displayedand related logical group.

[0177]FIG. 28 illustrates various objects in accordance with the presentinvention. The bookmark information (2801) contained by a bookmark is acollection of objects. An object is an information source which can bevery simple to very complex. Examples of objects are: a number (2820),text (2810), an image (2850), a graphic, a drawing component, a soundimage (2840), movie (2830) and an audiovisual image. Objects are alwaysavailable to the system and may be presented to the user. The initialpresentation is the first time that an object is presented to the user.The system may try to present an object more than once but the user willnot see a difference because the object is already presented. Differentobjects are presented in different ways. For instance, a number may beconverted to text and presented on the display as text. It also couldcause a light to flash in correspondence to the number. Text istypically displayed as text but could also be converted to speech andaudibly presented to the user. Movies would be presented in either oneor both its audio and visual components.

[0178] Multiple screens of various configurations can operate in asynchronized manner during the page-turning process. For example, threeappliances can be configured side-by-side in a linked mode. Whereas, theleft display is configured to display the first page and every other oddnumbered page thereafter; the middle display is configured to displayevery even numbered page; the right display is configured to display thesecond odd numbered page and every other odd page thereafter; and alldisplays are synchronized to display the pages of the piece in theproper order. If the left appliance receives a signal to change the pageorder, then it will revisit the last page that it displayed, and themiddle and right displays will follow. If the right appliance receives asignal to change the page order, then it will advance and send signalsto the left and middle appliances to advance accordingly. Theaforementioned page-change methodology utilized for system with multiplescreens may be logically adapted for use by systems with any number ofdisplays.

[0179] Page turning can also by synchronized among networked ones ofindependent ones of the appliances (linked sets and stand alone) so thatall networked appliances synchronously turn pages responsive to a singlesignal, such as from a conductor, stage hand, etc.

[0180] Referring again to FIG. 13, the navigation mode logic (step 630),responsive to the external input (step 609), and the program data forthe navigation/menus functionality, provides for user interfacefunctionality definition (step 631), and utilization of colors andshapes and locations to assist the user in navigating, based on feedbackof where the user is in the music selection relative to the bookmarklocations and colors and shapes as shown (step 632). Where the user hasprovided an external user input (step 609) such as actually selecting aspecific bookmark to navigate to, (step 630) leads to (step 633)providing navigational protocols. Responsive to this input, thenavigational protocol process (step 633) implements logic to cause theprocessor to find the data in memory corresponding to the bookmark andprovides for the appropriate image (e.g. the selected music data)display on the respective electronic music stand system's displayapparatus.

[0181] Bookmarking provides for marking of a location in the musiccomposition with a label, and provides a displayable table for userselection for navigation through the music composition. In this regard,the method further comprises selecting portions of the music data of theselected logical sections for bookmarking; selecting a specific locationwithin an associated identification (ID) within the selected portions;providing bookmark information; associating the bookmark informationwith the associated ID and the specific locations; and providing forselective display of the specific locations responsive to user inputbased on the respective bookmark information. The selection of portionsfor bookmarking can be embedded in the music data done by a user of thesystem of the present invention. Any type of user input is acceptable.User input of selections for bookmarking, specific locations andbookmark information can be via a user touch-screen input display, aswitch input, a button input, external computer download of controldata, voice recognition, etc. The method further provides formaintaining bookmark data for bookmark locations and storing thebookmark data; providing a bookmark selection mode for displaying thebookmark information and respective associated ID; providing forselection of the specific locations responsive to a bookmark selectioninput; and displaying a music visual display for the selected specificlocations. Thus, a user can quickly navigate through the entire musicalcomposition using the bookmarks.

[0182] The bookmarking method further comprises providing a display fora table of bookmarks representative of the bookmark data for at leastsome of the bookmarked locations. To facilitate quicker, easier and moreintuitive user interface, the present invention further comprisesstructuring layout of bookmarks in the display of the table of bookmarksin a physical juxtaposition and relationship to convey informationcontent by relative placement of the bookmarks. The structured layoutprovides information content relating to major movements, minormovements, relatively close sections, and relatively far sections viacolor and position of display of the bookmarks in the table. Color canalso be used to structure the layout.

[0183] Bookmark data is associated with a location on and within themusic notation. The user can provide input to select locations, entertext, and color choices, etc. Alternatively or additionally, the systemcan respond to control data—either embedded in the music data or asadditional data associated therewith, such as next logically associatedtransitions (e.g., a repeat) and loaded into the cache and prepared fordisplay. A second bookmark is defined by the association between thebookmark data and the next logically associated transition to provide asecond bookmark whose location is associated with the next logicalsection. There are two sources for the next logically associatedtransitions from a particular current location and video presentationdisplay of a single or multiple sections. The first source is thephysical layout of the music data and the rules of ordering and time formusic are used. For example, music is read from left to right, top tobottom and ascending page numbers. The second source for transitions iscontrol data, such as a second bookmark associated with the displayedsection. Both of these sources are used by cache logic to predict thepossible next section that the user may choose. This intelligentpre-loading of the cache memory by the cache logic predicts which musicdata (or other type of data, as appropriate) is needed in what order andassures its fast availability. This is very useful such as followingbranches outward where a user can select a bookmark on a displayedsection and if that bookmark has an associated second bookmark then thelocation associated with the second bookmark will be pre-loaded into thecache memory.

[0184] The Presentation GUI controls a cache of stored music (or othertype) data. Caching data is a commonly used method for optimizing systemspeed and enhancing performance, and various data-caching methodologiesare well-known and widely published (e.g.:—. Archimedia, ArchiveManagement System, System Overview. Bristol: K-PAR Systems,http://www.k-par.com; Johnsson, Bjorn Thor. Application-orientedBuffering and Caching Techniques. University of Maryland, PhD.Dissertation: 1998;—. How Caching Works. http://www.howstuffworks.com;Mazzucco, Paul. The Fundamentals of Cache. http://www.slcentral.com:2000; McCarthy, Tim. Building Your Own In-memory Data Cache.http://www.interknowlogy.com.) The music data can be stored locally orat a remote location. However, remotely stored data will produce slowerdisplay transitions, than locally stored data. The music data may bestored at a different resolution or may need to be otherwise altered fordisplay—further delaying presentation. The cache contains display-readydata for immediate display and is typically stored in the PerformerSystem's RAM. The cache selectively maintains previously displayedsections and anticipates the user's next request for data based uponhistorical usage and proximity to other sections within the context oflogical order. Cache-size is limited and configured for optimal systemperformance, so it is periodically refreshed as users introduce newdata. The cache may not be able to predict successive sections when themusician is not following the logical flow of the music with 100%accuracy (such as a random jump to an unrelated composition duringrehearsal). However, successively selected sections can be predictedwith 100% accuracy when the user follows the logical flow of the music(or other) content. The cache can load and prepare the next logicalsection for display transitions by obtaining music data from storage(local or remote) as a background function while the user views thepresently displayed music prior to requesting a transition. Optimally,the next logical section is ready for display upon request.

[0185] Similarly, bookmark data is associated with a location on themusic notation along with the next logically associated transitions(i.e., a repeat) and loaded into the cache and prepared for display.

[0186] As illustrated in FIG. 7A, in a preferred embodiment, eachperformer system saves an image of the respective music page in theshort-term cache (e.g., high speed RAM) of the Data Storage Apparatus(205) as shown in FIG. 7A. The processor (201) calculates the next mostlikely pages that the user may request to display. The processor thenreads the music page information from the long-term memory, typically ahard drive or flash ROM, of the Data Storage Apparatus (205) andtransfers it to the short-term cache performing any transformations ofthe data to prepare it for subsequent display. When the user requests anew page to be displayed (as described in the previous paragraph), thisprocess is increased in speed since the information has already beenpreloaded.

[0187] The casing (102) that houses the electronics of the electronicmusic stand performer system, as illustrated by FIG. 1, is mounted to astand: a vertically oriented support (107) that is coupled to afloor-base (108). In a preferred embodiment, the support (107) and base(108) are adjustable and provide pivoting and telescoping connectionsfor attaching to the mounting on the casing (102). Stands arecommercially available from vendors including: Wenger of Minnesota,U.S.A., and Manhassett Music Stands also of the U.S. Using VESA (VideoElectronics Standards Association) standard for computing devicemounting holes for mounting the casing (102) to the vertical support(107) provides for compatibility with any of a variety of industrial andconsumer stands and computer devices in compliance with the VESAstandard. A quick connect/disconnect mechanism can be mounted to thestand and the appliance casing to facilitate quicker setup andbreakdown. Examples of industrial and consumer stands in compliance withthe VESA standard (and quick connect/disconnect mechanisms) includecommercially available products from Ergotron, Inc. of St. Paul, Minn.and Compucaddy, both of the U.S.A. Alternatively, the casing (102) canbe handheld or mounted to or set upon another object (e.g., a piano,wall, table, etc).

[0188] The music notation data can be organized into compositions. AComposition Bookmark is defined at the beginning of each composition.Each composition can have a defined set of major pages—a movement. Thebeginning of each set of major pages can be identified by a MajorBookmark within a composition along with other significant rehearsalnumbers or letters identified as Minor Bookmarks. When bookmarks aredisplayed for the musician, all Composition Bookmarks are displayed. Inone embodiment, all Major Bookmarks are displayed that are associatedwith the current composition, and all Minor Bookmarks are displayed thatare associated corresponding to the current Major Bookmark. In apreferred embodiment, the musician needs to perform no more than threeselections to jump to any bookmark within the set of loadedcompositions.

[0189] Bookmarks are used to jump to specific sections in the music.Therefore, a bookmark must be associated with a specific location in themusic, rather than a formatted page. Bookmarks can be accessed invarious ways. For example, a series of bookmarks can be displayed,whereby the user selects the desired bookmark and the associated sectionis displayed.

[0190] Continuing in the book-marking process and function, the systemprovides for selection logic for selecting a portion of the music dataof the selected logical sections for book-marking by the user. Logicprovides for response to a user's selecting a specific location with anassociated I.D. within the selected portion. Association logicassociates the bookmark information with the associated I.D. and thespecific location. Bookmark logic provides for the selective display ofthe specific location responsive to user input based upon the user'sresponse to the respective displayed bookmark information. User inputcan be via user touch-screen input, external switches, a keyboard(physical or virtual via the touch screen) a button, voice recognition,or otherwise. A memory is provided for maintaining bookmark data for allbookmark locations, and selection logic provides for a bookmarkselection mode which displays a table of the bookmark information withrespect to the associated I.D. for the user to use. In a preferredembodiment, the librarian logic provides for selection of a specificlocation, while the performance logic provides for displaying the musicvisually for the selected specific location. The bookmark selection modecan provide for display of the table or a list of bookmarks, or anyother format for displaying the bookmarks, and providing for userselection of bookmarks providing for navigating through the logicalsections of the musical display in any order as defined by the user. Asdiscussed above, the layout of the bookmarks in the display of the tableis structured to facilitate ease of user utilization.

[0191] In accordance with one aspect of the present invention, in thebook-marking process and function, the system used on the illustratedappliance provides for selecting a previously defined bookmark andassociating a second bookmark with the first bookmark. Logic providesfor response to a user selecting the first bookmark by selecting thesecond bookmark and causing the second to be associated with the first.Association logic associates the first bookmark information with theassociated I.D. of the second bookmark in addition to previously definedinformation in the first bookmark. The second bookmark's associatedlocation can be on the same appliance as the first bookmark, or on aseparate appliance, or both. User input can be via user touch-screeninput, external switches, a button, voice recognition or otherwise. Inthe preferred embodiment, the first bookmark is displayed on the screenas text, an icon or user drawn images. The visible display of the firstbookmark is responsive to the user via touch-screen input, externalswitches, a button, voice recognition or otherwise. Search logicprovides for associating the visible display of the first bookmark,obtaining the associated I.D. of the second bookmark, searching for thesecond bookmark and obtaining the location associated with the secondbookmark. Display logic is then provided to begin the transition of thedisplay to cause the second bookmark's location to be displayed.

[0192] Multiple screens of various configurations can operate in asynchronized manner for movement from one section to another. Forexample, each device will move to a new section as directed by of one ormore of the networked appliances. When one of the appliances in thegroup is instructed to move to another section, via touch-screen orbutton, it sends a signal to all of the appliances in its group to moveto the same section.

[0193] By use of the association logic and the first and secondbookmarks, all coordinated appliances are able to display the samesection. A signal may be sent from one user to all of the users andappliances in the same group. For instance, the conductor may wish tohave the entire orchestra start at letter “B” and sends a signal to theentire orchestra to cause every appliance to display that section.Alternatively, the conductor can make a change to an individual part ofthe conductor's score, and the first and second bookmarks and theassociation logic provide for display of the conductor's marking on theappliance(s) for that respective individual part piece (e.g., all firstviolins). Alternatively, or additionally, the conductor can view theindividual part piece on the conductor's appliance. The displayed musicscore need not be identically formatted among appliances, butalternatively can be formatted to display different parts for theconductor, violins, cello, trumpet, drums, etc. Appliances can also beprogrammed to prompt the user to accept or deny signals from other useror appliances.

[0194] Another embodiment of accessing bookmarks allows a user tospecify a user-drawn notation associated with a bookmark. Thus, if theuser touches the screen on a bookmark notation, then the display wouldchange to the associated bookmark.

[0195] Alternatively, the bookmark list can be dynamically displayed anddetermined by the current section of displayed music. The bookmark listdisplays the bookmarks that are closest to the current section beingdisplayed. At the highest level, the first page of each score or musiccomposition is displayed. Then the major bookmarks (i.e., movements) ineach piece are displayed for the current score being displayed. Then theminor bookmarks (i.e., measure numbers, pages, letter/numbers, etc.) inthe current score (or music composition or script, etc.) are displayed.First the letters in the current major bookmark section are displayed.If room on the display is available, then all the minor bookmarks can bedisplayed for the current score.

[0196] The musician must be able to select the position of the music tobe displayed by moving sequentially forward or backward as previouslydescribed. However, there are many times when the musician needs to jumpto a particular page out of sequence, and bookmarks can be assigned touser selected specific locations in the music notation. The bookmarksare initially displayed for selection by the musician touching the touchscreen (or pointing to, pressing a button, or typing commands), in orderto display a list of bookmarks. Each bookmark can be named by the user,and thereafter selected from a list of user-defined bookmarks. ThePerformer System will then display the selected music notation data andpresent it in an appropriate format. The Performer System may useinformation about which pages are currently being display, which pageshave been displayed and which pages will likely be displayed next.

[0197] As shown in FIGS. 3, 8, and 16, the electronic music standprovides book-marking capability so that the user can navigate aroundthe music composition to find specific locations within the music andquickly jump to that location. The user interface is set up to optimizeintuitive use of the book-marking system. In a preferred embodiment,color-coding of the bookmarks is based on frequency of use, relativelocation of the selected bookmark in the overall ordering, andtimeliness of use. For example, the color black bookmark is the currentposition (prior to jumping to the bookmark table), while relativelyclose pages will be shown in green for their bookmarks with most or allof the closer pages displayed (such as every page or every other page),while relatively further pages are shown in a different color (such asblue) and less pages displayed only displaying one bookmark for everyfive, ten or larger numbers of pages. The choices of color and placementare design criteria the system designer can tweak and select. Thus,utilizing bookmarking conventions and protocols, the performer subsystemhelps the user intuitively navigate quickly through the bookmarks andimproved functionality is provided.

[0198] Musical notation is used, in the generic sense, to refer to anyway of conveying musical performance instructions including but notlimited to common musical notation with staffs, notes, sharps, fiats,and clefs, extending to written instructions in text form to supplementthis or supplant or partially replace, as well as alternate forms ofexpression such as chord charts, words and chords (letters), tablature,any video, graphic, audio, audiovisual or other display presentation orcombination of the aforementioned types of presentations. In addition tomusic notation, any other type of data can be displayed, such asscripts, text, images, video, etc.

[0199] Referring again to FIG. 13, when the Edit Mode (step 650) isselected, the processing provides for the user to make notation via theinput apparatus for display along with the display of the stored imagedata (e.g. music data) for display as an overlay to the otherwisedisplayed music image data. Each additional edit session can be saved asa separate image. Overlay layer, thus providing for storage of multiplesets of revisions.

[0200] In one embodiment, when user edits and notes are displayed on topof the music display, an Undo soft-touch button appears. This buttonwill undo and make invisible, but not delete, the last drawn line. Whenedits and notes are invisible on the music a Redo soft-touch buttondisplay appears. This button makes visible the last line made invisible.A Delete button also appears. The Delete button will delete permanentlyall invisible lines. Alternatively, the user can select particularrevisions to be deleted.

[0201] Music editing mode provides for user modification, deletion,copying and other operations on the music information displayed. In thismode the music display is slightly smaller to accommodate on-screensoft-touch buttons along the peripheral edges of the display (e.g. rightand bottom margins) to perform operations.

[0202] In a preferred embodiment, the draw mode allows the user to drawnotes or notations on the music or other displayed image. A set ofsoft-touch buttons are used to select a color. Another soft-touch buttonis used to select the width of the line drawn (e.g. thin, medium andwide (highlight)). When the user touches the screen in the displayedmusic area, the line is started. A line is drawn on the screen as theuser slides a finger or stylus across the screen and is completedwhenever the user stops touching the screen. Multiple lines can thus bedrawn. Pop-up palettes can be provided to provide standard notations forthe user to select and position on the display (e.g. staff line, clef,notes, accidentals, etc.)

[0203] The musician may need to add his own notation via an imageoverlay to the original music notation obtained by the Performer System.The musician can change the width, color and other characteristics ofthe lines drawn by touching, pointing to, pressing or typing the changeson specific touch-sensitive areas, specific buttons or entering specifictext commands. The image overlay is then added to the display of theimage whenever the particular image information is displayed. The linesare drawn by the musician touching, pointing to, pressing or typingcommands that describe where a line or lines should be drawn. As themusician moves the location of the touch-sensitive input, the line isextended to include that position. The end of the line can be definedwhen the user stops providing touch-sensitive input by removing his orstylus or finger from the screen, or does not provide any additionalinput during a pre-defined period of time. Additionally, exiting thedraw-mode effectively terminates any line that has not been previouslyterminated.

[0204] Lines are stored relative to the dimensions of the music notationdata and can be easily positioned relative to the music notation dataregardless of scale. Each line can be stored with a time-stamp thatindicates when the line was drawn. The time-stamp may be used asline-selection criteria, for storing and identifying levels of revision,etc.

[0205] The lines drawn can be selected to be opaque, completely coveringthe underlying music notation. The lines can also be selected to besemi-transparent and drawn in a manner called “Color Printing,” allowingthe underlying music notation to be visible through the overlay.

[0206] Selected lines can be made invisible in the reverse order thatthey are drawn—the last line drawn is the first to be made invisible.Alternatively, a user may select a particular line or lines or region ofdisplay by defining the corners of a rectangle. The selected lines canthen be made invisible responsive to the user. Invisible lines can becompletely removed from the Performer System as specified by the users,or be made re-visible as specified by the user.

[0207] The color of the line (CL) is determined by the user's selection,such as via “soft” touch screen buttons as discussed above, and hasthree components, red (RL), green (GL) and blue (BL). Each of thesecomponents can take on values from 0 to 255 where 0 is none and 255 isfull intensity. For example, when all three components are 0 the colorappears as black. When all are 255 the color appears as white. The lineis drawn using the color CL and combined with the color of the musicdata at each pixel where CP is the color at pixel at a particular pixelof music data to generate a new color (CN). The pixel color is notmerely replaced by CL because music data would be eliminated and thenwould become unreadable in that area. Instead CN is affected by both CLand CP. This method of combining the colors is called, Color Printing orColor Printed.

[0208] In one implementation, CN is Color Printed by combining CL and CPby multiplying each component of CL times the corresponding component ofCP and dividing by 255 and rounding to a integer. The rounding could beto the nearest integer, e.g., 11/4=3, or can use truncation, e.g.,11/4=2, or other method. For example, if CP was [10,150,255] and CL was[128, 200, 100] then CN would be [5, 118, 100]. A second implementationof Color Printing is defined by combining CL and CP bit-wise by AND-ingof the component values of CL in their standard binary representationwith the corresponding component values of CP. Using the above exemplaryvalues for CL and CP, the resulting CN for this implementation would be[0, 128, 100]. In both implementations, it is preferred to select CLwith all non-zero components so all the components of CN are dependenton CP also.

[0209] In a preferred embodiment, Redo and Delete buttons appear in theDraw mode. A Select feature allows the user to select specific lines(added by the user in edit/draw mode) on the screen by touching thescreen by touching the screen across the specific lines. All the lineswithin the box defined by the starting and ending points on the touchare selected. The selected lines can be enhanced by a “halo” display.When lines are thus selected, the Undo button appears. This button willundo and make invisible, but not delete, the selected lines.Additionally, when any area is selected, a “SEND” button appears. Ifthis button is touched (selected), a list of other appliances appears onthe communications network available to send the selected area to. Theuser can then select any available desired appliances, and the selectedarea of drawings are transmitted to the selected appliance orappliances.

[0210] The draw mode allows the user to draw notations on the music. Aset of buttons is used to select a color. Another button is used toselect the line-width, (e.g., thin, medium and wide (highlight)). Indraw-mode, the line begins where the user touches the screen andcontinues until the user stops touching the screen. Multiple lines canthus be drawn.

[0211] Preferably, the system utilizes a touch-screen overlaying thedisplay. The touch-screen may require the use of a special stylus, beopaque to block light beams, require direct contact by a hand, or it mayjust require pressure from any object. In some embodiments a visiblecursor is provided to assist the user to follow user input.

[0212] Alternatively, or additionally, a physically remote input deviceis used (instead of a touch-sensitive area overlay on the display),e.g., a traditional computer mouse, a keyboard, or set of physicalbuttons may be used to provide user input to the appliance. With anon-touch screen display, the display provides a visible cursor or othervisual cues so the musician can position the cursor in the correctlocation.

[0213] Buttons, typically implemented using switches, or via touchsensitive areas of screen display buttons can provide specific usercontrol over the device. A button can be integrated into the physicalcase of the Performer System or can be provided external to the case byplugging into the Performer System and located in the vicinity of thePerformer System to be more convenient for the musician to actuate thebutton. Also, external signals from other dissimilar devices may providean input to the Performer System. These inputs do not necessarilyrequire that a visual cue be provided on the screen. For instance, oneinput may cause the system to advance to the next logical page, whileanother may cause the system to return to the previous page, while yetanother input causes a jump to a defined bookmark, while yet anotherinput provides for controlled dimming or brightening of the display. Thetouch-sensitive inputs can be used by statically or dynamically definingareas of the touch-sensitive area that implement page-turning and otherfunctions such as mode changes, bookmarks, displaying information, andshutdown.

[0214] In accordance with one aspect of the present invention, themulti-dimensional music display, communication and transformation systemof the present invention also enables a user to select one or moremusical compositions from a larger database from a plurality of musicalcompositions. The database can be stored locally within the workstation,on site, or remotely stored and transmitted to the user (such as overcable, wire, telephone lines, wireless (such as radio frequencies)). Theuser can also optionally edit the selected score of the composition(such as changing the key and/or any note and/or timing, etc.) to suithis or her taste. The score (altered (the derivative composition) or not(the original composition)) can then be transmitted to one or moredisplays (such as liquid crystal or CRTs) in the music stands of theband or orchestra. The present invention, therefore, provides anefficient, paperless solution to communicating, presenting (displaying),and optionally one or more of transposing, editing, inputting,comparative testing-teaching, conducting, and disseminating music to onedisplay or a large number of displays. Each display can have the same,or a different, unique, customized presentation of music notation asappropriate per selection, responsive to a set-up by a system,automatically per predefined parameters, and/or to user input. The scorecan also be printed out if a hard copy is desired.

[0215] Modification can be performed on rhythm, primary key, individualnotes, chords, etc. The vast store of musical information stored indigital notation format and/or any video format, can be broadcast(analog or digital) to a local music workstation or a master controller,which can also be a local workstation. The master controller can be astand alone unit, or act as a server as well as its own stand aloneunit, or simply as a server to a plurality of other stand alone units.However, in the minimal configuration, only a single musical userstation is needed.

[0216] Referring again to FIG. 12, if no changes are desired, themusical score for the composition that is selected is broadcast,transmitted, or otherwise transferred to the workstation music standappliance (220). It is internally stored in the local workstation musicstand. Next, the score is displayed (225) on the workstation display(e.g., LCD or CRT) or a video projection system. The display can also bepart of an integral stand-alone workstation or an interconnected groupof components including a personal computer (such as Macintosh, or DOSor Windows PC).

[0217] Referring again to FIG. 12, the display mode selection is thenmade (1230). This permits selection of an operational display mode, notsimply choosing the resolution or color. The two main choices in thepreferred embodiment are a manual mode (1250) and an automated mode(1240). In the automated mode selection (1240), there are many sub-modesor options, such as the operational mode that permits the performer oruser to do their performing without having to tend to the selection ofthe portion of the music to be displayed or the turning of pages. In theauto performance mode as shown on LCD (135), there is provided thesimultaneous displaying of the selected musical composition, and adisplay representative of the audio performance of the user, and adivergence signal or divergence data representative of analyzing theperformance, preferably in approximately real-time.

[0218]FIG. 17 illustrates the manual mode (1250), which provides foruser manual selection of functions (1252). There are many functions thatthe user can select, even in the manual mode, such as hitting a buttonor a touch screen to cause the turning of the page of the display.Another function is to go back a page or to scroll forwards orbackwards. For those who are vision impaired, another function canincrease the font size or magnification of the music presentation.

[0219] Thus, there are many manually selected functions that can beprovided. While the manual mode can have automated functions selected,it is distinguished from the automated mode where control is partiallypre-defined without user assistance. In the manual mode (1250), the userselects any and all advanced features that are going to be provided(some of which can be automated). The selected function is thenprocessed (1256).

[0220] Next, any ongoing needs are processed (1257). These needs caninclude any overlapping automated function (not otherwise inconsistentwith any other selected function).

[0221] In one preferred embodiment, the workstation is provided as amusic stand where the display presentation is a liquid crystal display(LCD). The LCD that can provide monochrome, gray scale or high qualitycolor displays, depending on design and cost constraints and desires.Other display types can also be used. A touch-screen input can providefor simplified and adaptive user input selections. An optional built-inmetronome function can also be provided for display presentation (audioand/or video). In one embodiment a music sound subsystem provides forthe music to be audibly reproduced at the workstation through a speakeror headphone jack or other output. A SMPTE and/or MIDI interface canalso be provided, to permit external timing control for page turns, thedisplay and/or audio from MIDI music data, etc.

[0222] As illustrated in FIG. 13, when the system is in the Option Mode(630) (i.e. where Option Mode has been selected), the system proceeds to(steps 655; 660; 665; 670). In the Protocols Mode (step 655), the systemsets up defining protocols for user interface, communications,orientation of the display, etc. Other protocol set-ups include userlog-in, start-up state, color schemes, timing parameters, and others. Inthe Page Turning Options mode (step 660), the system permitsestablishment of page turning options. For example, by utilizing thetouch-screen input on the touch-screen display (or other input apparatusin conjunction with a non-touch screen display), the user can selectpage-turning options such as quick transition (nearly instant), fade,wipe, peel, or other effects. Additionally, the user can choose to set atime delay for the page turning time, and set time delays for transitionof the page turn from the top of the page while leaving the bottomvisible for a fixed (defined) time.

[0223] In a two-screen system, the second screen can continue to displaythe current page while the first screen can display the next pagesubsequent to that displayed on the second screen, with a predefinedtime delay added before changing the second (right) screen to itsrespective new page when implemented as a step (or delayed) page turnmode. In the stand alone mode of set up (step 665), the user sets up themusic stand performance system as a stand-alone system, with each of thetwo Performer Subsystem operating independently thereafter asstand-alone. A single screen Performer system inherently operates asstand-alone. Where multi-screen (linked set) mode (step 670) isselected, the user further proceeds to define options by makingselections of the displays of the Performer Subsystems defining thelogical order, from first to last (e.g. right to left tom to bottom,etc.), that each of the Performer Subsystems (e.g., FIG. 5B (500-A;500-B)) provide for display of music. In a preferred embodiment, thelinked system permits the user to define each of the linked subsystems'displays as a left page (step 671) as one or more middle pages (step672) (where appropriate), and as a right page (step 673). This can beextended to various sizes (e.g. 3″, 8″, 10″, 12″, 15″, 17″, 19″, etc.)and multiple display pages (2 screens, 3 screens, 4 screens, and soforth) and to provide additional options (e.g., changing displayorientation from portrait to landscape and vice-versa).

[0224] The system can be set to default (with no external user input)upon start up to commence operation in the performance mode and candisplay a predefined piece of music in accordance with start upparameters. Alternatively, the user can actively select the performancemode (step 640). In the performance mode, control and management ofdisplay of the music data, as well as page changes, caching, bufferingof data to increase operational speed, are provided. Forward andbackward page changes can be implemented in various ways. In oneembodiment, page changes are responsive to touching specified areas ofthe screen. These areas can either be in the same area where the musicis displayed or in an area of the screen not covered by the music data.

[0225] For example, in FIG. 5, a forward page change would be moderesponsive to a touch of screen (504) and a backward page change couldbe made responsive to a touch of screen (503). The pages on the screens(503; 504) would change by two pages with screen (504) always containing(displaying) the next logical page after the page displayed on screen(503). In FIGS. 1 and 4, a forward page change would be responsive to atouch of the right side of screen (135; 404). The backward page changewould be responsive to touching the left side of screen (135; 404). Thepage change in FIGS. 1 and 4 would only change the displayed page byone. In FIG. 6, a forward page change is responsive to a touch of screen(605) and the right side of (604). The backward page change isresponsive to a touch of screen (603) and the left side of screen (604).In the manner described for FIG. 1, the pages would be ordered by theirposition but in FIG. 4 each subsystem would move 3 pages.

[0226] As illustrated in FIG. 8, Appliance Options logic (1006) providesthe user with selection of display and page-turning options regardingthe presentation of the appliance. For example, on one selected optionsscreen display, selection of one button toggles the background colorbetween various levels from normal (white) to inverse (black). Anotherbutton provides for selection of changes in the transition betweenImmediate, Step and Reveal types of page transitions. Alternatively, oradditionally, each of the performer subsystems is selectively responsiveto an external control signal which triggers selective dimming andbrightening of the brightness level of the display and/or remote controlof page changes, or downloading of program, control, or music data.

[0227] The system and methodology of the present invention eliminatesmost of the annoyances in performing music using any written notation(whether on paper or electronically displayed on a presentationapparatus such as a screen) is smoothly performing music and timing“flips of pages”, as well as the inefficiency and time losses involvedin the communication of change to a third party. This even moreimportant when user is marching, and/or where both hands are requiredsimultaneously to play an instrument.

[0228] As discussed above herein, in accordance with the presentinvention when a new section of music is displayed on an appliance,there are multiple page-turn transitions that can occur depending uponsetup selection. A first transition is the Quick or Instant page-turn.The display of new information immediately replaces the currentdisplayed sections with the new sections to be displayed.

[0229] A second transition is a step change page-turn. The first portionof the entire display immediately changes when the transition starts(such as activated by a touch or switch or other activation). The firstportion is the top half (approximately) of the display in the case of asingle screen display (stand-alone mode) appliance. In the case ofcombined “linked set” appliances, the entire display of the firstappliance in the linked set group immediately changes. After a userdefinable delay, or system default delay, the rest of the displayedsections are changed and new data is displayed. During the transition, abar (a gray or colored wide line) is displayed between the old displayand new. This allows the musician to quickly observe the musictransition process and determine which transitions have occurred.

[0230] A third transition method is a reveal page-turn, where the newsections progressively reveal themselves to replace the older displayfrom the first section to the last in a smooth transition. The musicdoes not move, the new music simply progressively covers up the old. Thespeed of the transition can be controlled by the musician, or controlledby a system default value.

[0231] The display options provided include not only the one screen andtwo screen options and multiple screen options where there are more thantwo screens, but additionally provide partial page (e.g. marching bandor half screen) options as well as multiple cascaded screen options.

[0232] The presentation upon the display apparatus for music is at leastone of the same page as equivalent printed music, a subsection of theequivalent printed music, and a completely repaginated version of theequivalent printed music. Alternatively, or additionally, text, scripts,or other image data can be displayed.

[0233] Where music data has predefined sections defined (such asdefinition of predefined sections embedded within the music data), thedisplay shows one or more of the predefined sections in a logical order.

[0234] For a two-page display, the presentation upon the displayapparatus can range from a portion of a page of the printed musicequivalent to two or more pages of the equivalent printed music.

[0235] The format of the displayed music can be identical to or varyfrom the printed sheet music from which the displayed music is derived.If the displayed music is divided into sections, e.g., individualsystems (a complete set of staff lines), measures or notes, a subsectionof the printed sheet music, then the music needs to have predefinedsections in order for the display to show single or multiple sections ina logical order. The appliance interprets the size and logical order ofthe sections in order to currently determine and anticipate subsequentnumbers of sections and measures to display on the screen. Thus, ascreen can display two or more pages, or a portion (or portions) of asingle page (or from multiple pages) of the printed music score orcomposition from which the music is derived. The screen can displaymusic that has been re-paginated to include a different number ofmeasures or sections than are printed per page on the correspondinghard-copy of the music.

[0236] The sections can be advanced via several alternative methods. Forexample, the screen can have a touch-sensitive surface, enabling theuser to touch the right side of the screen and cause the sections toadvance instead of turning a physical page. Touching the left side ofthe screen will cause the sections to go to the previous logicalsections or pages. Alternatively, a physical button or a switch can beused to advance or revisit the sections to be displayed. The physicalbutton or switch may be located on the appliance or connected externalto the appliance for the operation by the hand, foot, leg, arm, etc.Optionally, an external signal can trigger page turn on the appliance.

[0237] Additionally, the sections can be advanced by an external signalfrom one appliance to another. When appliances are linked as a set andare networked and synchronized, in the linked mode one appliancedisplays the even pages (typically left side) and the other appliancedisplays the odd pages (typically right side)—like a book. For example,the two coordinated appliances in a linked set respond to the signalsfrom each other and display the appropriate sections; though theirrespective display formats may vary. In a synchronized mode, the leftside of the “screen” is actually the entire left display, because theuser perceives the “screen” to be the composite of all the appliancesused to display the music. In a synchronized mode, the right side of the“screen” is actually the entire right display, because the userperceives the “screen” to be the composite of all the appliances used todisplay the music. A signal sent to advance the displayed images causesall synchronized appliances to advance the same number of pages as aredisplayed at the time the signal is sent. For instance, if two pages aredisplayed at the time a signal is sent to advance, then the next twopages of the same music score will be the displayed. Alternatively, theuser can set up page turns to be one (or other number of) page(s) at atime on the linked set.

[0238] The display can advance the music by page option, or by a userselection of one of many options (e.g., scrolling, tablature, videographic, tutorial display, etc.).

[0239] Referring to FIG. 18, the automated mode 1 for auto-advanceoperation (1242) of FIG. 15A is illustrated, where the user has selectedan auto-advance performance mode. In this mode “A Mode 1” (1271), thesystem tracks the performance by the user of the composition to themusic notation (e.g. composition or score) (1272). Performance refers tothe actual performance by an individual person (or people) who is (are)reading the musical score upon or composition which the performance isbased. Whether that score is in tablature format, staff and clef andnote notation, or some other format, the system generates appropriatesignals to permit comparison of the user's performance to the musicalscore.

[0240] As illustrated in FIG. 19, automated mode 3 “A Mode 3” is theperformance mode (1246). In this mode, the operation is as in automatedmode 1 (auto-advance mode) except that no user over-ride is permitted.Its primary purpose is to accompany the performer during the entireperformance of a score as an automated page turner. The tracking of the“page turning” to the performance can optionally be based on inputs orcriteria independent of a performer's actual performance input (e.g.,microphone), such as a built-in metronome clock, a central control(e.g., a conductor or special user input), an externally provided pageturn signal, etc. In one embodiment, the appliance provides for a manualoverride mode which provides for an emergency stop, and switch over toManual Mode. Additionally, performance characteristics can be tracked,computed, and reported as in the teaching and training mode. Trainingfeedback can optionally be provided real-time, or subsequent tocompletion of performance, to assist the performer as in the trainingmode. Alternatively, the score can be presented in a moving score mode(e.g., vertically, horizontally, or otherwise) or a linear presentationas opposed to a page turning display.

[0241]FIG. 20 shows the operation of automated mode 4 (“A Mode 4”) whichprovides for the processing of other automated functions selected by thesystem. These modes can include conductor mode, karaoke mode, etc.

[0242] Referring again to FIG. 18, in accordance with another aspect ofthe present invention, means are provided for moving through the printed(displayed) notation of the music in synchronization with the liveperformance from the displayed musical notation.

[0243] Based on a comparison, a decision is made pursuant to selectioncriteria programmed into the system (such as the rate at which the pieceis being played, the time signature, the tempo, the rhythm, and theadvancement of the music on the available display), the displaypresentation is advanced (1274 and 1278). In some cases, the music mightmove backwards, such as with a repeat or a D. S. Coda. The presentationof the display tracks the performance to permit smooth, uninterruptedplaying or singing. The capability can be provided for the user toover-ride this auto-advance, such as for practicing where it is desiredto keep going back over sections. In this case, a user over-ride option(1276) is permitted to alter the automated operation. Upon activation orcessation of user over-ride, the system can be programmed to stop, toautomatically return to the regular auto-advance mode, to jump to adefined location, or to process other auto-modes (1270) of FIG. 15A.

[0244] The override can cause the progression to go backwards orforwards in the music score, irrespective of the normal progression ofreading of it. The performance mode AutoMode blocks the user override topermit performance according to proper material timing. Thisautomatically moves through the musical score as written and preferablyshows an indication of metronome time and an indication of the properplace in the score where the performer should be for that instrument atany specific time. This is especially valuable in a conductor mode ofnetworked communication, where a conductor couples to one or more musicworkstations. The conductor (or Librarian) can optionally be providedoverride, stop, start, and tempo change capabilities as a “super-user”in all modes.

[0245] Additional types of inputs that can initiate a “page turn”include voice or sound recognition apparatus built into the electronicmusic stand system. This sound recognition apparatus has the ability touse pattern recognition specific to the sound, or specific to the uservoice and/or words being spoken (for extremely high accuracy). Ofcourse, any type of user actuated device such as a foot or hand switch,or head motion device, or sound or voice recognition system touch screeninput, etc. In a preferred embodiment, is selectively permitted tocontrol the activation or override of the normal progression of themusic's play.

[0246] As illustrated in FIG. 14, in one embodiment, the user inputmeans (411) is comprised of a key switch device, such as a touchmembrane keypad or capacitance touch surface. In a preferred embodiment,the user input is provided via a touch screen display technology. Touchscreen technology permits the programmable display of user interactiveicons and legends including text and graphics making possible unlimitedcustomization of user input structure according to task needs. Thus, tocreate a musician intuitive interface, specific switches or sequences oftouches to the touch screen can be associated with common use icons fromthe task being performed in conjunction with words to provide ultimateclarity. User error is virtually eliminated, with the aid of automaticentry error detection, defined fields, mandatory fields, etc.

[0247] Alternatively, microphone input (527) can provide for coupling ofuser speech to a processing subsystem (such as a Master Music Controller(415)) or processor sub-system ((280) of FIG. 2) that uses any of anumber of commercially available and well-known speech recognitionalgorithms. These algorithms provide for speech recognition inputcontrol, either solely or as a supplement to touch screen or othertactile input mechanisms.

[0248] Voice recognition and response to conductor (or other person's)commentary can supplement the system. The system could record themessage, interpret to whom the conductor directed the message and conveyit audibly or translate it into a text or icon display as a part of thesystem's audiovisual presentation. Alternatively, or additionally,instant messaging, can be provided via voice recognition, keyboardinput, touch screen input, audio input, or a combination of these.

[0249] In accordance with one aspect of the present invention, means areprovided to accept inputs from one or more sources that initiates a“page turn”. Types of inputs include conventional touch input apparatus(such as key switches or capacitive touch pads), motion sensing gear,sound recognition, external control signaling, and automatically whenoperating in the operational mode of Auto Mode. The motion sensing gearcan be for a portion of the performer's body, such as a head tilt sensoror an optical eye movement sensor, etc.

[0250] A new form of communication is created in that both the processof communicating via standard notation is respected and adhered to,while at the same time permitting interaction and communication of musicmedia signals.

[0251] The input of monitored movement data is provided to the userworkstation, permitting precise mechanics training such as fingerposition, the angle of striking of strings relative to the neck of aviolin (or guitar, etc.) or they can be used to permit the virtualperformance of music by a performer using a virtual link apparatus suchas a virtual reality glove or bow and/or pick movement detectionapparatus. The user can then perform a piece with their ownpersonalization without any musical instrument in fact.

[0252] For example, the guitar portion for a piece of music could bedisplayed in notation form and actually performed according to thetiming of movements of the user's fingers (either actual fret positions,or only timing information). To add further reality, a mock guitar,keyboard, flute, or other instrument can be used and combined withvirtual effects to provide for music performance and personalization.Thus, for entertainment purposes, users could perform as part of asymphony orchestra playing a violin portion. If they performed out oftime, they would hear their instrument's performance out of synch withthe rest of the orchestra's performance.

[0253]FIG. 21 illustrates a conductor, stage hand, or other person witha sensor glove on each hand (1435) and a head and eye movement monitor(1430). The figure also illustrates the conductor wearing full bodysensor equipment (1440). Either embodiment or combined embodiments canbe used to map body movements. If only the gloves (1435) or body sensors(1444) are used, the movement of the glove or sensors can be captured bya video system, as illustrated in FIG. 22.

[0254] In one embodiment, a motion sensor subsystem (422) monitorsmotion of a target person and responds with signal outputs in accordancewith predefined movement interpretation characteristics parameters, suchas for a conductor.

[0255] In conductor mode, a conductor can control communications ofsignals to his or her performer (such as “increase volume”, or “increasetempo”, or “play staccato”). Icons can be provided where the conductorsimply touches a touch screen (or other input mechanisms) to supplementhis hand and body motions to permit more effective communication withthe performers. Alternatively, as illustrated in FIGS. 9 and 10, in amore advanced system version, the conductor's movements are firstlearned by a monitoring system, based on user definition and assignmentof meanings for movement to provide an expert knowledge database.

[0256] This system also provides for tracking of movement input. Asillustrated in FIG. 22, a video camera (1405) provides for input of theconductor (1415) against a backdrop (e.g., blue screen) (1410), which isprocessed by video processing unit (1420), or, alternatively as shown inFIG. 21, via body glove technology (gloves (1435) or sensors (1444) orsensor clothing (1440) or head or eye movement tracking sensor (1430)(such as used in virtual reality, flight simulation, avionics equipments(such as jets and space travel), and sports players for analyzingmovement) to provide the necessary movement input signals. This movementinput is analyzed utilizing the expert knowledge database (eitherlearned or preprogrammed) to automatically generate a display (videoand/or audio) to provide local visual and/or audio reinforcement on thelocal display (such as overlaying on a then unused portion of the musicscore display as a picture in a picture) to permit audio and videoreinforcement of the conductor's body language. Thus, for example, “ahush” body language signal that is directed towards a particular sectionof the orchestra would automatically be interpreted to cause the systemto indicate, and only on that particular section's respective displays,a message (e.g., a big face with a finger in front of it making a hushsound, and possibly with a “hush” sound simultaneously output from aspeaker (in rehearsal mode)). The conductor mode provides many benefitsto performance and communication.

[0257] There are numerous ways to embody the conductor movementinterpretation system. As illustrated in FIGS. 21 and 22, one isutilizing the body movement detection apparatus prevalent in virtualreality, sports medicine, etc., as discussed above, to identify specificmovement patterns or signal parameters associated with certain movementpatterns, to initiate a display presentation, audio, video, oraudiovisual to provide a presentation associated with the movement ofthe conductor. Alternatively, other techniques can be used such astaking the video feed from a video camera or other video source (e.g.VCR) and having the conductor interpret his movements and assign themunique meanings, to create a lexicon of his movements and correspondingmeaning.

[0258] For example, rapid downward movements of the hand from up todown, in a certain manner, indicate “decrease the volume.” When hepoints at a particular section at the same time as he is doing that, heis indicating that only that orchestra section is to reduce volume. Inthis manner, either camera input of movements, glove sensing ofmovements, or other techniques (such as audio, ultrasonic, etc.) can beused to track movement to permit associated meanings to be attached orindexed to particular signal parameters or parametric signals of themeaning of the movement parameters as provided by the conductor inputdevice. For example, in the case of the virtual reality glove, thatinput would be the signal output of the glove as interpreted byassociated software in a processor (such as a PC or a MAC).Alternatively, for example, in the case of video camera input, it couldbe pattern recognition or analog or digital signal comparison todetermine the presence of certain signal patterns indicating to thesystem to initiate automatic communication of a conductor presentation.In so doing, the conductor is able to rapidly convey his meaning, focusit to a particular group of instruments, and be done with it. He doesn'thave to focus very long or concentrate to make sure they've gotten hissignal. Instead he can focus on listening to see if they got hismessage.

[0259] Simple things, like looking for the conductor's rapid handmovements, focusing on specific hand movement areas, facial and headmovement, arm movements, and body language can all be programmed intothe recognition knowledge base. Technology for complete mapping of bodymovement that are utilized in making video games of today areillustrated in Video Systems magazine, page 42, October 1995, Vol. 21,No. 11, and NEXT Generation magazine, pages 49-54, October 1995, bothincorporated herein by reference.

[0260] As illustrated in FIG. 21, the conductor wears a sensor equippedbody suit (1440) and gloves (1435). In another embodiment, the conductorwears only the sensor-equipped gloves (1435) of FIG. 9. In still anotherembodiment, the conductor's movements are picked up by the video camera((1405) of FIG. 22) and processed, without using a sensor suit.

[0261]FIG. 22 illustrates a video camera (1405) and a standing conductor(1415) (or performing musician to be tracked or virtually linked toperform), with or without a blue screen (1410) behind him. The videocamera (1405) feeds a video signal to the video processing system (1420)that utilizes signal processing to provide signal pattern recognitioncapability. The blue in the screen is filtered out in the signalprocessing, such as by an Ultimate or other process.

[0262] Other methods that capture motion rely on specialized sensors ormarkers (1444) placed on a performer's joints, such as via a sensor bodysuit (1440). Once motion has been filmed or analyzed, a data set isproduced to interpret that movement into Cartesian co-ordinates. Theseco-ordinates provide the spatial location of each of those markers. Thisinformation is then cleaned up and can be input to an animation package,or fed to a processing system.

[0263] The use of virtual reality technology, including motion sensorsand body gloves, permits monitoring of various other things (as shown inFIG. 21). For example, as shown in FIG. 22, a camera in conjunction withanalysis logic, such as expert software, can monitor motion of rolemodel (e.g. teacher) behavior and compare performer (e.g. student)behavior. Hand, finger, arm, leg, eye, head, body, and mouth movementscan all be monitored and constructive critical feedback can beaccumulated, analyzed, and fed back to the user or teacher, forperformer training, or performances, or for conductor communication.

[0264] In any event, having now obtained knowledge related torecognition of the movements, the system can interpret them and utilizethem to convey presentation information to the ensemble or orchestra orstudio members, or to analyze a performer's movements, or to permit avirtual performance. One example would be a large screen television ormultiple large screen televisions for viewing by the members of theviewing group. Alternatively, each music stand could provide for apicture in picture display of special movements of the conductor inareas of the display where music is not currently being played. Sincethe stand can have the intelligence to compare the performed music tothe played music, that embodiment permits display of the message inpotions of the music display area which have already been performed orare not going to be performed for some time (e.g., at least ten secondsin either direction; other criteria could alternatively be used, and canbe set up for desired characteristics of the performing environment.)

[0265] From the foregoing, it will be observed that numerous variationsand modifications may be effected without departing from the spirit andscope of the invention. It is to be understood that no limitation withrespect to the specific apparatus illustrated herein is intended orshould be inferred. It is, of course, intended to cover by the appendedclaims all such modifications as fall within the scope of the claims.

What is claimed is:
 1. A method for providing for video display of animage responsive to image data stored in an image database, the methodcomprising: defining a page of image data from the image database;defining first slices of the image data for a first orientation;defining in a second orientation second slices of the first slices todefine logical sections; ordering the first slices from beginning toend; ordering the second slices from beginning to end; mapping the firstslices, the second slices, the logical sections, and the ordering of thefirst slices and of the second slices; storing the mapping in a memoryfor selective retrieval; and providing for the video display of theimage responsive to the mapping and the storing.
 2. The method as inclaim 1, further characterized in that the first orientation equalsvertical, the second orientation equals horizontal, wherein thebeginning equals top for vertical, wherein the end equals bottom forvertical, wherein the beginning equals left side for horizontal, andwherein the end equals right side for horizontal.
 3. The method as inclaim 1, wherein the step of providing for the display of the image isfurther comprised of: defining a display width and display height forthe windows to be used for display of the image; selecting from thelogical sections to determine a best fit to the display width and thedisplay height responsive to the mapping and the storing; and displayingthe selected ones of the logical sections on a video display to providea best fit responsive to the selecting.
 4. The method as in claim 3,further characterized in that the display width equals a maximum widthfor the display, and the display height equals a maximum height for thedisplay.
 5. The method as in claim 1, further comprising: selectingportions of the image data of the selected logical sections forbookmarking; selecting a specific location within the portions;associating an associated identification (ID) with the specificlocations; providing bookmark information; associating the bookmarkinformation with the associated ID and the specific location; providingfor selective video display of the specific locations responsive to userinput based on the respective bookmark information.
 6. The method as inclaim 5, further comprising: associating the bookmark information with asecond associated bookmark ID; selecting a first bookmark responsive toa user input; searching for a second bookmark having the respectivefirst associated ID equal to the second associated ID of the respectivefirst bookmark, responsive to the selecting of the first bookmark;obtaining the specific locations associated with the second bookmarkresponsive to the searching; and providing for visual display of thespecific locations associated with the second bookmark.
 7. The method asin claim 5, further comprising: providing for user input of selectionsfor bookmarking, specific locations and bookmark information via atleast one of a user touch-screen input display, at least one switchinput, and at least one button input.
 8. The method as in claim 5,further comprising: providing a bookmark selection mode for displayingthe bookmark information and the respective associated ID; providing forselection of the specific locations responsive to a bookmark selectioninput; and displaying a music visual display for the selected specificlocations.
 9. The method as in claim 8, further comprising: providing adisplay for a table of bookmarks representative of the bookmarkinformation for at least some of the bookmarked locations.
 10. Themethod as in claim 9, further comprising: structuring layout ofbookmarks in the display of the table of bookmarks in a physicaljuxtaposition and relationship to convey information content by relativeplacement of the bookmarks in the visual display.
 11. The method as inclaim 10, wherein the structured layout provides information contentrelating to major movements, minor movements, relatively close sections,and relatively far sections via color and position of display of thebookmarks in the table in the visual display.
 12. The method, as inclaim 1, wherein the image is music, wherein the image data is musicdata, and wherein the image database is a music database.
 13. An imagedisplay system comprising: a source of an image database providing imagedata representative of visual images; a video display providing a videopresentation having a defined display size; a processing subsystemcomprised of a processor, memory providing instruction data and otherdata; and a user input providing at least for user selection of thedisplay size, wherein the processor is responsive to the user selectionof the display size and to the instruction data for compatibility withthe defined display size, providing for successive sub-sectioning of acomposition of the image data providing for definition of a page ofimage data from the image database; definition of first slices of theimage data for a first orientation; and definition of a secondorientation of second slices of the first slices to define logicalsections; wherein the processor provides for ordering the first slicesfrom beginning to end; and then ordering the second slices frombeginning to end; wherein the processor provides for storing in thememory a mapping of the first slices and of the second slices forselective retrieval; and wherein the video display provides a visualpresentation of visual images responsive to the mapping.
 14. The systemas in claim 13, wherein the visual images are representative of visualimages of music notation.
 15. The system as in claim 13, wherein thevisual images are representative of visual images of text.
 16. Thesystem as in claim 13, wherein the first orientation equals vertical andthe second orientation equals horizontal; wherein the beginning equalstop for vertical; wherein the end equals bottom for vertical; andwherein the beginning equals left side for horizontal, and wherein theend equals right side for horizontal.
 17. The system as in claim 13,wherein the display size provided is utilized in defining a maximumdisplay width and a maximum display height for the video presentation;wherein selected ones of the logical sections are selected to determinea best fit to the maximum display width and the maximum display heightresponsive to the mapping and the storing; and wherein the selected onesof the logical sections are provided as a video presentation on thevideo display so as to provide a best fit.
 18. The system as in claim13, wherein responsive to the user input of selecting portions of theimage data of the selected logical sections for bookmarking, andselecting a specific location within the portions and providing bookmarkinformation, the system associates an associated identification (ID)with the specific location; and wherein the system further provides forassociating the bookmark information with the associated ID and thespecific location; wherein thereafter the processor subsystem isresponsive to the user input, to provide for selective video display ofthe specific locations responsive to user input based on the respectivebookmark information.
 19. The system as in claim 18, wherein thebookmark information is associated with a second associated bookmark ID;wherein the system is responsive to a user input for selecting a firstbookmark; wherein the processing subsystem searches for a secondbookmark having the respective first associated ID equal to the secondassociated ID of the respective first bookmark, responsive to theselecting of the first bookmark, to obtain the specific locationsassociated with the second bookmark responsive to the searching; andwherein the system provides for visual display of the specific locationsassociated with the second bookmark.
 20. The system as in claim 18,wherein the user input provides for selection of bookmarking,identification of specific locations and entry of bookmark informationvia at least one of a user touch-screen input display, at least oneswitch input, voice recognition and at least one button input.
 21. Thesystem as in claim 18, wherein the system provides a bookmark selectionmode for displaying the bookmark information and the respectiveassociated ID; wherein the user input provides a bookmark selectioninput; wherein selection of the specific locations is responsive to thebookmark selection input; and wherein the display provides a videopresentation for the selected specific locations.
 22. The system as inclaim 21, wherein the system further provides a video presentation for atable of bookmarks representative of the bookmark information for atleast some of the bookmarked locations.
 23. The system as in claim 22,wherein the processing subsystem provides for structuring a layout ofbookmarks in the video presentation of the table of bookmarks in arelationship to convey information content by relative placement of thebookmarks in the visual display.
 24. The system as in claim 23, whereincolor of bookmarks in the video presentation is utilized in thestructuring to convey relative position of the bookmarks to one another.25. The system as in claim 23, wherein the structured layout providesinformation content relating to relative importance of the specificlocation, relatively close sections, and relatively far sections viaposition of display of the respective bookmarks in the table in thevisual display.
 26. The system as in claim 24, wherein the structuredlayout provides information content relating to relative importance ofthe specific location, relatively close sections, and relatively farsections via color and position of display of the responsive bookmarksin the table in the visual display.
 27. A method of displayingperformance notation for performance data comprising: definingparameters for selecting logical sections from the performance data;defining parameters for determining logical ordering of the logicalsections and for defining advancement of display of the performancedata; defining the slices and the logical ordering responsive to theparameters; evaluating the performance data to find a largest logicalsection, responsive to the parameters, utilizing the largest logicalsection to define a scale for other ones of the logical sections to bedisplayed; and, displaying the performance data as a video displaypresentation responsive to the defined slices and the defined logicalordering.
 28. The method as in claim 27, wherein the performancenotation is music notation, and wherein the performance data is musicdata.
 29. The method as in claim 27, wherein the performance notation isscript and wherein the performance data generates a video displaypresentation of script pages.
 30. The method as in claim 27, furthercomprising: advancing a display presentation of the performance data byutilizing the defined slices and the defined logical ordering.
 31. Themethod as in claim 27, further comprising: providing for user definitionof at least some of the parameters.
 32. The method as in claim 27,further comprising: defining page-size and pagination of the displaypresentation of the performance data responsive to the parameters. 33.The method as in claim 32, further comprising: defining parameters for anumber of image slices per display presentation; advancing the displaypresentation of the performance data responsive to the definedparameters for the number of image slices and logical ordering.
 34. Themethod as in claim 33, further comprising: providing for user definitionof the parameters for the number of image slices. defining a defineddisplay width and a defined display height for the display to be usedfor display of the music data; providing for the selective variation ofsize and orientation for the display presentation of the performancedata responsive to the defined display width and selecting from thelogical sections to determine a best fit to the defined display widthand the defined display height responsive to the parameters and theperformance data; and displaying the selected ones of the logicalsections on a video display to provide a best fit responsive to theselecting.
 35. The method as in claim 28, further comprising: initiallydefining page-size and pagination for the display presentation of theperformance data responsive to a default ordering of the sections ofperformance data.
 36. The method as in claim 35, wherein the music datais coupled from a source, the method further comprising: initiallydefining the page-size and pagination for the default ordering of thelogical sections of performance data responsive to parameters defined bythe source.
 37. The method as in claim 36, further comprising: logicallyordering and displaying the logical sections responsive to theuser-defined parameters in that order, rather than in the defaultordering.
 38. The method as in claim 27, further comprising: advancing adisplay presentation of the performance data by utilizing the definedslices and the defined logical ordering.
 39. The method as in claim 33,further comprising: providing for user definition of the parameters forthe number of image slices. defining a defined display width and adefined display height for the display to be used for display of themusic data; providing for the selective variation of size andorientation for the display presentation of the performance dataresponsive to the defined display width and selecting from the logicalsections to determine a best fit to the defined display width and thedefined display height responsive to the parameters and the performancedata; and displaying the selected ones of the logical sections on avideo display to provide a best fit responsive to the selecting.
 40. Amethod for processing and structuring image data to provide for videodisplay presentation thereof, the method comprising: analyzing the imagedata; setting parameters defining the image data into defined pageshaving a given display resolution and size; defining first slices of theimage data for a first orientation; defining second slices of each ofthe first slices to define logical sections; ordering the slices frombeginning to end; ordering the first slices from beginning to end, andordering the second slices from beginning to end.
 41. The method as inclaim 40, further comprising: mapping of the first slices and the secondslices, respectively, to the ordering of the first slices and the secondslices, respectively.
 42. The method as in claim 41, further comprising:displaying the music image data responsive to the mapping. definingsecond slices of each of the first slices to define logical sections;ordering the slices from beginning to end; ordering the first slicesfrom beginning to end, and ordering the second slices from beginning toend.
 43. The method as in claim 40, further comprising: defining displaywidth and height; selecting from the logical sections to determine abest fit to the display width and the display height; and processing todetermine the best fit responsive to the selecting from the selectedones of the logical sections; and, providing a display presentation ofselected ones of the logical section responsive to the processing toprovide a display presentation on a video display.
 44. The method as inclaim 40, wherein the image data is music image data, and wherein thevideo presentation is of pages of music notation.
 45. The method as inclaim 40, wherein: the first orientation equals vertical, and the secondorientation equals horizontal, where the beginning equals top forvertical, where the end equals bottom for vertical, where the beginningequals left side for horizontal, and where the end equals the right sidefor horizontal.
 46. The method as in claim 40, wherein: the firstorientation equals horizontal, and the second orientation equalsvertical, where the beginning equals top for vertical, where the endequals bottom for vertical, where the beginning equals right side forhorizontal, and where the end equals the left side for horizontal. 47.The method as in claim 40, further comprising: ordering the first slicesfrom beginning to end; ordering the second slices from beginning to end;mapping and storing the first slices, the second slices, the logicalsections, and the ordering of the first slices and of the second slices;and providing for the display presentation of the music data responsiveto the mapping and the storing.
 48. A method for providing an display ofmusic images responsive to music data from a music database, comprisedof: first defining logical pages of music image data from the musicdatabase; ordering the logical pages of music image data so as to be ina logical page order in correspondence to a defined page orderingparameter; obtaining a first page; defining first slices; obtaining afirst slice; defining second slice for the first slice; repeatedlyobtaining a next first slice, and if found, defining second slices,until there are no remaining frames of the first slices and a completelysliced page is then completed; and providing the completely sliced pagefor use in generation of a visual display.
 49. The method as in claim48, wherein defining the first slices by at least one of: obtaining userinput to describe break points between the first slices; obtainingpreviously stored information associated with a current display page andautomatically finding horizontal lines which cross blank portions of thecurrent display page.
 50. The method as in claim 49, further comprising:obtaining user input to describe break points between the second slicesto define the page ordering parameter.
 51. The method as in claim 49,further comprising: obtaining previously stored information associatedwith a current page to define the page ordering parameter.
 52. Themethod as in claim 49, further comprising: automatically findingmeasures in the music to define the page ordering parameter.
 53. Themethod as in claim 48, further comprising: continuing processing when nomore first slices are found to define the page as a completely slicedpage, and proceeding to obtain a next page and repeat the method untilno further pages are available.
 54. The method as in claim 48, furthercomprising: ordering the second slices responsive to the page orderingparameter; ordering all the second slices within a page by the firstorientation; ordering all the second slices within a page and a firstslice grouping by the first orientation; creating logical groups ofsecond slices; first creating an empty logical group; getting the nextordered second slice, if available; processing to determine whether thissecond slice will fit on the display along with other second slices inthe respective logical group; adding the respective second slice if itis determined that it will fit, and adding the slice to the respectivelogical group; retrieving the next second slice; determining when therespective second slice cannot be added to the respective logical groupand storing in a defined order the respective logical group in a localstorage; determining when there are no more second slices to process,and storing in a defined order the respective logical group in the localstorage; and; providing for the visual display of the logical groups ofsecond slices in the order stored in the local storage.
 55. The methodas in claim 54, further comprising: associating bookmarks with variouslocations on the pages; selecting the bookmarks for display; orderingthe bookmarks in a same order as the logical groups are stored in localstorage; associating for every bookmark, a location on a respective pageso that a respective bookmark is associated with a respective one of thelogical groups when the respective bookmark falls within a displayablearea covered by the respective logical group.
 56. The method as in claim55 further comprising: selecting the respective bookmark; checking therespective bookmark to determine its type and whether it is at least oneof a composition bookmark indicating the beginning of a compositionbookmark, a section bookmark and a simple bookmark; treating all thefollowing logical blocks as a part of a same composition responsive tothe composition bookmarks until another composition bookmark is found;treating all the following logical blocks as a part of that section ofthe composition responsive to the section bookmark until another sectionbookmark or a composition bookmark is found; and treating only a singleone of the logical blocks as associated with a simple bookmarkresponsive to the simple bookmark.
 57. The method as in claim 56,further comprising: creating a display list of the compositionbookmarks, the section bookmarks, and the simple bookmarks; associatinga common display color with each of the types of bookmarks.
 58. Themethod as in claim 57, further comprising: determining whether abookmark is associated with a logical block within a current displayedsection; displaying the bookmark as black rectangular-shaped button in alist of bookmarks.
 59. The method as in claim 55, further comprising:associating an object with one of the respective bookmarks; associatingthe location of the respective bookmark with the respective objects;associating the respective logical group with the respective object. 60.The method as in claim 59, further comprising: providing a presentationresponsive to the respective object concurrently with the display of therelated logical groups.
 61. The method as in claim 60, wherein theobject is comprised of at least one of: control data, a video image, adrawing component, a sound image, a movie.
 62. The method as in claim59, further comprising: initiating a defined action responsive to theobject.
 63. The method as in claim 62, wherein the defined action isresponsive to an event, wherein the event is comprised of: providing aninitial presentation; selecting one of a logical group and an object;and one of creation of and destruction of one of the logical groups orobjects from the stored information.
 64. The method as in claim 62,further comprising: causing a specific logical block to be displayedresponsive to the object, and sending information to another systemcausing the changing of state of an object of another system.